-- Logs begin at Mon 2022-09-12 22:49:08 UTC, end at Mon 2022-09-12 23:46:10 UTC. -- Sep 12 23:19:30.480708 dv-cinder-852009-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 23:19:30.489528 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 23:19:30 2022] *** Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: nodename: dv-cinder-852009-7-iscsi Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: machine: x86_64 Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: clock source: unix Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: pcre jit disabled Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: detected number of CPU cores: 4 Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: current working directory: / Sep 12 23:19:30.491504 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: detected binary path: /usr/bin/uwsgi-core Sep 12 23:19:30.492238 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: your processes number limit is 47680 Sep 12 23:19:30.492238 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: your memory page size is 4096 bytes Sep 12 23:19:30.492238 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: detected max file descriptor number: 2048 Sep 12 23:19:30.492238 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: lock engine: pthread robust mutexes Sep 12 23:19:30.492238 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: thunder lock: enabled Sep 12 23:19:30.492238 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 23:19:30.492238 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 23:19:30.531091 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: Python main interpreter initialized at 0x55a8d297f9c0 Sep 12 23:19:30.531091 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: python threads support enabled Sep 12 23:19:30.531091 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: your server socket listen backlog is limited to 100 connections Sep 12 23:19:30.531091 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: your mercy for graceful operations on workers is 90 seconds Sep 12 23:19:30.531433 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 23:19:30.531514 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: *** Operational MODE: preforking *** Sep 12 23:19:30.531766 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: *** uWSGI is running in multiple interpreter mode *** Sep 12 23:19:30.531766 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: spawned uWSGI master process (pid: 105433) Sep 12 23:19:30.531947 dv-cinder-852009-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 23:19:30.533278 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: spawned uWSGI worker 1 (pid: 105434, cores: 1) Sep 12 23:19:30.533278 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: spawned uWSGI worker 2 (pid: 105435, cores: 1) Sep 12 23:19:30.533278 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 23:19:31.181612 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:19:31.185917 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:19:32.259018 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:19:32.259018 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: from cryptography.utils import int_from_bytes Sep 12 23:19:32.259613 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:19:32.259613 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: from cryptography.utils import int_from_bytes Sep 12 23:19:32.260378 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:19:32.260378 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: from cryptography.utils import int_from_bytes Sep 12 23:19:32.260803 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:19:32.260803 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: from cryptography.utils import int_from_bytes Sep 12 23:19:34.756715 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:19:34.757288 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:19:34.757495 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:19:34.757859 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:19:34.758117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:19:34.758505 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.758834 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.759152 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.759471 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.759835 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.760665 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.760987 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.761074 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:19:34.761437 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:19:34.761520 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.761625 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.761806 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:19:34.761900 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.762170 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:19:34.762291 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.762422 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:19:34.762511 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-7-iscsi {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.762808 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.762906 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.763115 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.763255 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.763425 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.763517 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.763768 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.763870 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.764075 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.764163 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.764396 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.764492 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.764703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.764797 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.765017 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.765200 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.765343 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766334 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766442 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766522 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766589 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766661 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-7-iscsi {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766733 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766830 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766907 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.766974 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.767044 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.767114 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.767186 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.767411 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.767520 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.767742 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.767830 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.768065 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.768155 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.768379 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.768473 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.768787 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-7-iscsi {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.768874 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.769112 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.769217 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.769422 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.769522 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.769735 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.769831 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.770075 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.770161 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.770388 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.770473 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.770696 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.770788 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.771014 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.771100 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.771319 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.771404 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.771664 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.771765 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.771975 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.772063 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.772308 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.772404 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-7-iscsi {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.772629 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.772723 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.772951 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.773050 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.773256 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.773353 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.773566 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.773662 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.773877 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.773971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.774198 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.774298 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.774508 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.774605 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.774818 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.774918 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.775071 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.775159 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.775380 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.775468 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.776321 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.776427 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.776643 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.776736 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.776964 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.777050 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.777218 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.777562 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.777729 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.777824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.778050 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.778149 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.778373 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.778460 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.778684 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.778782 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.778997 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.779115 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.779243 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.779331 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.779535 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.779689 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.779879 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.779981 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.780200 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.780306 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.780510 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.780603 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.780759 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.780845 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.781007 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.781124 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.781324 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.781443 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.781642 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.781767 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.781950 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.782076 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.782256 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.782399 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.782560 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.782799 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.782886 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.783054 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.783147 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.783362 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.783456 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.783729 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.783820 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.784051 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.784144 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.784360 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.784447 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.784671 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.784767 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.784986 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.785080 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.785292 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.785380 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.785597 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.785696 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.785906 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.786005 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.786225 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.786312 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.786528 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.786613 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.786860 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.786953 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.787114 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.787200 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.787416 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.787510 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.787747 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.787849 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.788070 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.788162 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.788377 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.788463 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.788679 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.788771 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.788984 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.789071 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.789287 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.789372 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.789615 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.789710 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.789917 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.790010 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.790167 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.790290 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.790465 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.790602 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.790767 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.790909 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.791084 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.791255 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.791411 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.791584 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.791743 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.791893 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.792054 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.792202 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.792340 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.792511 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.792645 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.792831 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.792952 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.793152 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.793254 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.793459 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.793550 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.793767 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.793864 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.794073 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.794169 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.794381 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.794470 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.794701 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.794795 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.795001 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.795100 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.795305 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.795400 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.795643 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.795733 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.795954 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.796043 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.796257 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.796345 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.796562 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.796659 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.796867 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.796955 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.797170 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.797265 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.797484 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.797571 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.797783 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.797871 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.798084 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.798170 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.798397 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.798485 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.798704 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.798791 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.799004 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.799103 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.799315 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.799401 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.799627 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.799728 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.799930 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.800016 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.800231 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.800329 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.800532 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.800628 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.800831 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.800929 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.801132 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.801229 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.801435 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.801529 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.801739 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.801835 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.802042 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.802150 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.802342 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.802429 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.802644 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.802732 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.802946 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.803043 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.803247 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.803342 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.803549 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.803647 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.803879 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.803986 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.804194 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.804283 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.804513 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.804599 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.804822 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.804910 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.805128 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.805222 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.805432 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.805526 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.805751 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:19:34.805848 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.806086 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.806181 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.806416 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.806503 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.806737 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.806825 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.807079 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.807167 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.807403 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.807499 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.807750 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.807841 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.808069 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.808166 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.808384 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.808551 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.808700 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.808787 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.809023 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.809121 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.809333 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.809427 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.809646 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.809738 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.809960 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.810056 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.810283 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.810379 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.810595 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.810693 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.810924 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.811024 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.811241 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.811338 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.811558 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.811678 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.811899 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.811987 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.812214 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.812324 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.812526 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.812614 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.812840 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.812931 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.813157 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.813247 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.813466 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.813553 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.813800 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.813889 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.814115 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.814205 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.814436 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.814534 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.814755 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.814852 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.815072 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.815176 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.815384 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.815474 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.815716 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.815807 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.816027 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.816115 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.816339 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.816426 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.816653 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.816742 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.816965 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.817052 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.817283 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.817372 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.817595 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.817692 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.817912 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.817999 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.818221 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.818315 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.818532 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.818628 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.818847 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.818935 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.819155 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.819260 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.819465 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.819581 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.819795 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.819885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.820105 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.820195 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.820411 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.820508 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.820724 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.820814 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.821031 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.821119 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.821354 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.821451 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.821682 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.821771 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.821991 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.822079 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.822307 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.822412 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.823145 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.823250 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.823452 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.823540 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.823807 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.823912 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.824095 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.824182 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.824401 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.824488 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.824713 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.824801 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.825027 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.825121 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.825333 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.825427 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.825659 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.825747 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.825966 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.826051 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.826277 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.826376 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.826588 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.826675 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.826899 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.826986 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.827206 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.827308 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.827519 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.827681 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.827858 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.827946 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.828167 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.828267 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.828480 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.828567 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.828789 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.828875 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.829097 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.829186 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.829412 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.829499 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.829718 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.829804 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.830028 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.830116 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.830345 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.830432 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.830656 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.830751 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.830968 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.831066 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.831281 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.831368 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.831609 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.831702 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.831923 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.832014 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.832236 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.832338 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.832546 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.832656 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.832850 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.832939 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.833159 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.833253 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.833469 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.833570 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.833774 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.833919 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.834081 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.834170 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.834386 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.834483 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.834692 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.834781 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.834996 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.835091 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.835299 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.835404 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.835628 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.835735 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.835928 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.836018 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.836236 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.836326 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.836541 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.836635 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.836844 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.836932 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.837149 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.837239 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.837453 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.837540 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.837757 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.837844 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.838098 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.838764 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.838943 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.839032 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.839256 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.839345 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.839560 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.839725 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.839886 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.839985 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.840233 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.840331 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.840540 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.840634 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.840851 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.840939 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.841176 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.841273 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.841490 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.841585 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.841812 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.841900 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.842123 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.842219 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.842440 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.842544 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.842752 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.842858 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.843058 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.843155 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.843364 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.843451 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.843695 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.843785 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.844015 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.844121 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.844327 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.844415 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.844645 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.844744 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.844955 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.845045 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.845278 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.845366 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.845589 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.845676 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.845901 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.845989 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.846204 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.846291 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.846519 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.846606 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.846858 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.846946 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.847179 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.847264 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.847494 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.847602 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.847840 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.847928 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.848148 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.848234 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.848463 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.848563 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.848773 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.848860 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.849082 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.849168 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.849385 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.849480 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.849695 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.849781 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.850013 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.850099 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.850323 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.850418 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.850638 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.850725 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.850948 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.851034 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.851267 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.851367 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.851586 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.851674 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.851909 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.852009 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.852211 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.852312 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.852516 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.852603 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.852825 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.852924 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.853134 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.853235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.853450 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.853538 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.853785 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.853871 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.854096 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.854183 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.854403 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.854491 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.854710 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.854803 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.855018 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.855106 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.855323 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.855410 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.855648 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.855751 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.855961 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.856059 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.856277 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.856365 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.856587 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.856683 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.856895 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.856982 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.857198 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.857285 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.857511 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.857618 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.857816 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.857906 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.858116 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.858203 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.858421 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.858518 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.858728 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.858826 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.859035 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.859124 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.859340 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.859436 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.859693 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.859800 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.860013 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.860140 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.860317 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.860405 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.860666 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.860779 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.860938 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.861024 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.861245 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.861334 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.861550 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.861638 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.861857 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.861946 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.862162 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.862251 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.862481 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.862592 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.862794 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.862898 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.863101 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.863199 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.863407 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.863504 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.863742 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.863845 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.864050 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.864136 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.864359 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.864455 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.864665 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.864765 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.864973 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.865068 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.865288 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.865382 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.865600 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.865698 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.865904 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.865991 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.866210 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.866297 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.866520 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.866617 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.866830 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.867090 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.867186 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.867433 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.867529 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.867764 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.867852 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.868075 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.868173 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.868385 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.868481 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.868691 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.868796 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.869001 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.869089 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.869345 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.869439 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.869712 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.869909 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.870028 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.870241 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.870334 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.870556 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.870657 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.870875 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.870964 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.871224 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.871320 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.871532 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.871655 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.871866 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.871956 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.872174 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.872262 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.872486 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.872574 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.872793 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.872883 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.873113 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.873248 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.873402 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.873495 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.873708 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.873797 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.874018 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.874113 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.874324 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.874424 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.874626 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.874713 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.874932 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.875021 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.875241 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.875336 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.875544 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.875664 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.875871 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.875959 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.876175 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.876272 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.876480 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.876570 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.876791 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.876877 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.877097 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.877193 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.877407 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.877502 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.877711 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.877806 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.878031 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.878121 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.878339 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.878426 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.878643 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.878731 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.878944 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.879032 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.879253 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.879340 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.879616 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.879706 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.879904 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.879997 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.880234 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.880374 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.880529 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.880619 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.880833 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.880923 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.881145 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.881234 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.881457 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.881554 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.881768 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.881864 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.882077 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.882171 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.882381 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.882476 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.882682 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.882769 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.882984 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.883080 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.883290 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.883385 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.883614 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.883708 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.883922 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.884011 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.884226 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.884324 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.884533 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.884628 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.884839 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.885423 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.885670 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.885759 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.885982 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.886070 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.886285 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.886372 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.886597 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.886685 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.886902 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.886996 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.887203 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.887298 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.887507 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.887611 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.887843 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.887930 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.888148 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.888236 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.888451 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.888546 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.888758 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.888852 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.889060 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.889156 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.889365 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.889452 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.889670 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.889758 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.889974 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.890074 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.890278 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.890365 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.890584 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.890679 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.890890 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.890988 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.891192 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.891280 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.891513 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.891655 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.891849 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.891950 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.892154 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.892242 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.892459 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.892546 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.892768 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.892869 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.893073 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.893159 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.893374 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.893459 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.893678 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.893768 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.893984 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.894072 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.894291 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.894378 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.894593 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.894689 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.894896 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.894985 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.895195 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.895282 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.895498 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.895607 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.895829 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.895917 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.896134 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.896233 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.896434 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.896520 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.896735 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.896831 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.897039 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.897135 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.897342 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.897429 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.897645 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.897732 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.897968 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.898066 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.898277 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.898365 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.898579 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.898679 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.898883 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.898981 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.899185 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.899273 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.899500 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.899605 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.899845 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.899942 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.900159 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.900250 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.900475 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.900564 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.901336 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.901442 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.901645 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.901734 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.901956 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.902051 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.902268 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.902620 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.902844 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.902933 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.903146 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.903232 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.903460 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.903557 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.903798 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.903887 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.904103 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.904196 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.904404 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.904493 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.904709 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.904807 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.905014 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.905111 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.905327 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.905417 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.905633 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.905727 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.905950 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.906046 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.906264 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.906352 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.906577 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.906673 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.906877 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.906975 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.907185 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.907272 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.907490 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.907607 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.907821 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.907920 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.908134 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.908222 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.908440 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.908527 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.908751 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.908838 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.909063 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.909151 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.909370 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.909458 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.909683 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.909772 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.909991 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.910078 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.910300 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.910409 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.910621 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.910726 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.910913 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.911150 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.911251 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.911468 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.911590 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.911811 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.911903 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.912122 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.912213 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.912438 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.912536 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.912740 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.912829 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.913055 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.913154 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.913361 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.913463 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.913828 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.914101 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.914191 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.914411 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.914513 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.914736 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.914833 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.915030 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.915141 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.915346 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.915519 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.915685 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.915783 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.916009 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.916094 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.916341 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.916432 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.916727 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.916817 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.917037 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.917129 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.917345 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.917436 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.917653 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.917745 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.917958 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.918047 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.918265 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.918356 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.918579 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.918671 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.918905 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.918997 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.919673 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.919745 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.919825 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.919899 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.919974 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.920041 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.920141 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.920347 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.920503 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.920655 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.920820 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.920954 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.921160 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.921280 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.921478 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.921608 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.921786 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.921917 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.922207 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.922297 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.922523 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.922612 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.922836 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.922925 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.923163 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.923259 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.923475 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.923584 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.923820 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.923916 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.924129 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.924218 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.924445 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.924535 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.924756 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.924894 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.925078 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.925165 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.925400 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.925487 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.925715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.925883 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.926032 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.926121 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.926340 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.926435 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.926665 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.926766 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.926989 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.927077 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.927305 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.927401 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.927650 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.927756 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.927982 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.928077 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.928292 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.928380 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.928600 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.928697 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.928927 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.929016 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.929236 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.929323 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.929550 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.929639 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.929865 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.929952 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.930176 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.930264 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.930482 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.930578 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.930788 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.930953 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.931109 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.931197 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.931411 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.931507 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.931749 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.931887 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.932088 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.932191 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.932400 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.932489 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.932707 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.932795 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.933011 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.933108 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.933333 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.933433 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.933639 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.933728 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.933947 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.934050 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.934254 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.934343 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.934564 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.934652 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.934883 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.935024 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.935188 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.935278 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.935510 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.935632 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.935845 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.935943 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.936149 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.936238 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.936454 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.936543 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.936761 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.936850 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.937103 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.937190 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.937409 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.937496 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.937732 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.937820 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.938053 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.938141 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.938378 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.938473 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.938685 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.938773 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.938994 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.939092 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.939306 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.939408 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.939640 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.939780 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.939955 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.940051 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.940265 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.940362 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.940579 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.940667 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.940883 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.941012 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.941187 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.941288 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.941493 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.941582 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.941796 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.941891 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.942103 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.942205 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.942410 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.942507 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.942720 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.942809 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.943025 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.943122 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.943331 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.943418 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.943655 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.943757 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.943982 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.944085 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.944286 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.944376 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.944606 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.944694 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.944915 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.945011 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.945222 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.945313 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.945525 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.945613 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.945830 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.945919 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.946156 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.946243 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.946466 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.946560 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.946779 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.946866 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.947088 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.947174 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.947402 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.948038 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.948241 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.948330 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.948556 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.948652 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.948874 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.948976 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.949187 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.949275 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.949501 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.949717 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.949807 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.950050 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.950140 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.950367 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.950457 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.950684 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.950782 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.950999 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.951095 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.951316 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.951405 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.951657 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.951874 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.951965 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.952208 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.952296 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.952528 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.952617 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.952843 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.952933 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.953158 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.953254 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.953472 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.953569 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.953786 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.953876 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.954099 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.954194 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.954414 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.954512 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.954725 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.954813 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.955036 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.955125 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.955351 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.955518 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.955707 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.955808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.956033 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.956122 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.956345 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.956435 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.956662 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.956752 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.956976 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.957062 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.957290 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.957388 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.957602 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.957690 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.957913 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.958012 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.958227 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.958315 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.958541 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.958636 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.958853 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.958951 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.959164 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.959260 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.959476 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.959562 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.959813 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.959915 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.960130 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.960226 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.960442 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.960538 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.960787 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.960931 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.961062 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.961186 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.961373 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.961461 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.961683 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.961771 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.961996 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.962205 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.962319 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.962523 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.962655 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.962858 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.962946 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.963797 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.963897 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.964133 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.964270 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.964456 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.964555 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.964778 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.964990 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.965109 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.965306 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.965408 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.965639 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.965736 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.965968 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.966067 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.966290 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.966380 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.966607 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.966695 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.966924 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.967020 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.967237 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.967325 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.967544 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.967662 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.967875 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.967964 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.968185 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.968272 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.968491 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.968724 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.968822 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.969078 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.969167 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.969400 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.969493 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.969708 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.969806 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.970030 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.970118 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.970345 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.970433 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.970656 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.970882 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.971000 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.971229 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.971333 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.971548 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.971688 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.971897 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.971986 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.972216 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.972310 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.972526 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.972628 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.972833 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.972926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.973147 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.973233 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.973454 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.973549 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.973761 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.973855 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.974075 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.974172 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.974387 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.974486 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.974689 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.974776 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.974998 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.975086 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.975306 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.975409 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.975636 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.975749 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.975944 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.976045 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.976255 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.976359 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.976556 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.976643 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.976861 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.976947 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.977171 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.977259 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.977475 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.977561 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.977782 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.977887 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.978092 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.978186 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.978397 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.978482 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.978736 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.978832 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.979052 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.979140 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.979360 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.979446 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.979698 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.979803 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.980009 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.980096 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.980327 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.980426 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.980634 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.980732 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.980947 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.981031 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.981290 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.981383 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.981599 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.981694 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.981905 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.981993 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.982228 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983152 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983253 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983342 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983429 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983509 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983607 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983607 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983766 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983848 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.983926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.984061 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.984148 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.984389 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.984490 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.984720 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.984815 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.985038 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.985125 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.985349 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.985569 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.985658 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.985905 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.985992 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.986227 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.986340 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.986560 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.986664 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.986873 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.986959 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.987187 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.987283 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.987490 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.987597 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.987823 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.987909 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.988133 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.988232 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.988447 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.988534 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.988755 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.988840 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.989064 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.989150 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.989370 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.989455 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.989680 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.989773 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.989988 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.990075 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.990301 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.990397 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.990611 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.990698 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.990919 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.991015 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.991228 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.991322 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.991536 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.991717 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.991871 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.992017 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.992180 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.992338 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.992489 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.992653 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.992804 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.992967 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.993160 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.993282 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.993460 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.993594 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.993776 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.993914 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.994093 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.994245 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.994963 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.995117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.995263 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.995404 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.995546 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.995862 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.996090 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.996180 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.996412 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.996498 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.996740 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.996834 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.997071 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.997175 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.997386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.997472 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.997712 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.998041 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.998136 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.998360 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.998447 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.998682 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.998775 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.998995 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.999089 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.999308 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.999401 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.999657 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.999749 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:34.999984 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.000080 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.000300 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.000388 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.000615 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.000713 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.000926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.001013 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.001236 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.001323 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.001551 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.001651 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.001876 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.001964 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.002192 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.002280 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.002501 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.002595 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.002810 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.002897 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.003115 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.003200 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.003424 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.003518 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.003758 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.003847 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.004069 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.004162 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.004379 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.004465 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.004688 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.004774 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.004997 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.005102 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.005301 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.005388 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.005607 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.005694 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.005912 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.006007 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.006218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.006306 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.006524 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.006609 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.006874 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.006966 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.007137 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.007232 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.007443 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.007537 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.007772 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.007872 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.008079 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.008173 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.008381 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.008473 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.008693 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.008789 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.008999 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.009085 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.009307 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.009393 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.009610 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.009710 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.009916 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.010040 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.010270 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.010358 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.010604 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.010700 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.010935 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.011021 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.011249 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.011390 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.011577 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.011667 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.011897 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.011984 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.012224 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.012322 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.012538 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.012626 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.012852 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.012943 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.013169 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.013264 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.013481 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.013574 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.013793 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.013879 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.014105 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.014191 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.014418 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.014505 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.014731 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.014817 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.015048 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.015259 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.015348 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.015420 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.015848 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.015956 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.016028 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.016258 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.016437 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.016616 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.016710 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.016925 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.017195 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.017346 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.017538 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.017674 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.017856 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.017992 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.018174 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.018324 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.018486 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.018613 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.018803 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.019079 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.019184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.019396 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.019492 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.019735 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.019828 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.020048 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.020151 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.020361 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.020468 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.020680 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.020784 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.020995 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.021084 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.021307 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.021409 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.021621 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.021730 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.021936 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.022034 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.022252 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.022347 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.022583 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.022811 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.022957 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.023096 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.023230 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.023363 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.023508 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.023692 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.023866 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.023953 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.024182 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.024268 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.024494 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.024650 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.024769 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:19:35.024865 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.025163 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.025483 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.026339 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.026706 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:19:35.026889 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:19:35.181881 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO dbcounter [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Registered counter for database nova_api Sep 12 23:19:35.189961 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO dbcounter [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Registered counter for database nova_api Sep 12 23:19:35.201980 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_db.sqlalchemy.engines [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.208818 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writer thread running {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.209255 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_db.sqlalchemy.engines [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.216082 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writer thread running {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.265599 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.context [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96429caa-1467-4b07-a047-7b6621f3163f(cell1) {{(pid=105435) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:19:35.269409 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_concurrency.lockutils [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:19:35.269890 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_concurrency.lockutils [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:19:35.271076 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.context [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96429caa-1467-4b07-a047-7b6621f3163f(cell1) {{(pid=105434) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:19:35.271456 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_concurrency.lockutils [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:19:35.272236 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_concurrency.lockutils [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:19:35.272685 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_concurrency.lockutils [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:19:35.274688 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_concurrency.lockutils [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:19:35.274890 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:19:35.275359 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:19:35.277956 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO dbcounter [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Registered counter for database nova_cell0 Sep 12 23:19:35.278167 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:19:35.278893 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:19:35.279337 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:19:35.281648 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:19:35.281975 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO dbcounter [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Registered counter for database nova_cell1 Sep 12 23:19:35.283674 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO dbcounter [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Registered counter for database nova_cell0 Sep 12 23:19:35.287616 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO dbcounter [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Registered counter for database nova_cell1 Sep 12 23:19:35.289910 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_db.sqlalchemy.engines [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.292204 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_db.sqlalchemy.engines [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.294767 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_db.sqlalchemy.engines [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.296456 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_db.sqlalchemy.engines [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.299645 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writer thread running {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.299995 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writer thread running {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.302236 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writer thread running {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.304480 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writer thread running {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.444550 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO dbcounter [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Registered counter for database nova_cell0 Sep 12 23:19:35.452992 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO dbcounter [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Registered counter for database nova_cell0 Sep 12 23:19:35.454284 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG oslo_db.sqlalchemy.engines [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.459208 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writer thread running {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.461947 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_db.sqlalchemy.engines [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:19:35.467049 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writer thread running {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:19:35.802164 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: WARNING keystonemiddleware.auth_token [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:19:35.810007 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: WARNING keystonemiddleware.auth_token [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:19:35.817662 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: WARNING keystonemiddleware.auth_token [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:19:35.824992 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: WARNING keystonemiddleware.auth_token [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:19:36.155667 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: WARNING keystonemiddleware.auth_token [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:19:36.161557 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: WARNING keystonemiddleware.auth_token [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:19:36.169272 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: WARNING keystonemiddleware.auth_token [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:19:36.169410 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a8d297f9c0 pid: 105434 (default app) Sep 12 23:19:36.171411 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:19:36.172619 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001790 Sep 12 23:19:36.173028 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Mon Sep 12 23:19:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:19:36.175217 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: WARNING keystonemiddleware.auth_token [None req-03800474-270e-42e9-9eea-4f899cea9295 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:19:36.180607 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a8d297f9c0 pid: 105435 (default app) Sep 12 23:20:57.339814 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:20:57.340829 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 12 23:20:57.341424 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:20:57.353310 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_api:SELECT=3 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:57.354421 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_cell0:SELECT=3 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:57.355411 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_cell1:SELECT=3 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:57.356318 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:20:58.219726 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-b645e8f7-9b93-4564-a6a7-270bce922de8 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:20:58.252371 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-b645e8f7-9b93-4564-a6a7-270bce922de8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904114 Sep 12 23:20:58.253102 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Sep 12 23:20:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:21:00.862170 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:00.863184 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-35774467-b94f-4a59-b061-434bd0b0f497 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 12 23:21:00.864334 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:01.327002 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-d82e3b3b-8590-4685-bad1-29287d41602c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:01.373091 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-d82e3b3b-8590-4685-bad1-29287d41602c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502769 Sep 12 23:21:01.373671 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:21:01.387607 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_api:SELECT=3 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:01.389624 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_cell0:SELECT=3 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:01.390363 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_cell1:SELECT=3 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:01.391102 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:01.600606 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-6824be2e-236f-42b7-8693-5e2b9a546a09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:01.668827 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-6824be2e-236f-42b7-8693-5e2b9a546a09 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286304 Sep 12 23:21:01.669414 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Sep 12 23:21:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:04.244377 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-d82e3b3b-8590-4685-bad1-29287d41602c admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:04.245635 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-d82e3b3b-8590-4685-bad1-29287d41602c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Sep 12 23:21:04.246168 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:04.897881 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-05128b46-73a8-4c53-ad09-24da51af1b18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:04.942287 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-05128b46-73a8-4c53-ad09-24da51af1b18 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688731 Sep 12 23:21:04.943313 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:21:04.956381 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-b5a03ba6-592c-408c-9107-6dab762c9624 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:05.016492 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-b5a03ba6-592c-408c-9107-6dab762c9624 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063584 Sep 12 23:21:05.022806 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Sep 12 23:21:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:21:07.653763 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-05128b46-73a8-4c53-ad09-24da51af1b18 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:07.654788 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-05128b46-73a8-4c53-ad09-24da51af1b18 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 12 23:21:07.655210 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:08.070577 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-cda0cfbb-3c8e-459d-84d1-7109af4d4537 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:08.091202 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-cda0cfbb-3c8e-459d-84d1-7109af4d4537 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427907 Sep 12 23:21:08.091702 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:21:08.104848 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-fb118e26-d9b2-4886-b9f9-3db0534651ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:08.131939 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-fb118e26-d9b2-4886-b9f9-3db0534651ad admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031514 Sep 12 23:21:08.132512 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Sep 12 23:21:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:10.724919 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-cda0cfbb-3c8e-459d-84d1-7109af4d4537 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:10.725946 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-cda0cfbb-3c8e-459d-84d1-7109af4d4537 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 12 23:21:10.726405 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:11.145826 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-b850d378-f6bd-4f3d-97a9-634deeb272d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:11.165719 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-b850d378-f6bd-4f3d-97a9-634deeb272d2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433325 Sep 12 23:21:11.166646 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:21:11.178625 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-3849d61a-8b69-43e7-a4f4-ceaeffe9388f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:11.205604 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-3849d61a-8b69-43e7-a4f4-ceaeffe9388f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030759 Sep 12 23:21:11.206278 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Sep 12 23:21:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:21:13.833755 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-b850d378-f6bd-4f3d-97a9-634deeb272d2 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:13.834703 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-b850d378-f6bd-4f3d-97a9-634deeb272d2 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 12 23:21:13.835106 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:14.262700 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-efc3c9ad-6c88-4e0d-9bde-a27e93bee9bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:14.280903 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-efc3c9ad-6c88-4e0d-9bde-a27e93bee9bb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439511 Sep 12 23:21:14.281455 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:21:14.294032 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-faa0eda6-3fa6-457a-856e-0a9759661ef3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:14.318775 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-faa0eda6-3fa6-457a-856e-0a9759661ef3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028519 Sep 12 23:21:14.319375 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Mon Sep 12 23:21:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:17.413647 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-efc3c9ad-6c88-4e0d-9bde-a27e93bee9bb admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:17.414678 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-efc3c9ad-6c88-4e0d-9bde-a27e93bee9bb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 12 23:21:17.415086 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:17.825048 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-67703f20-26e3-4103-8d1d-1608f735d2be admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:17.856221 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-67703f20-26e3-4103-8d1d-1608f735d2be admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.434886 Sep 12 23:21:17.856916 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Sep 12 23:21:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:21:20.451155 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-efc3c9ad-6c88-4e0d-9bde-a27e93bee9bb admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:20.452105 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-efc3c9ad-6c88-4e0d-9bde-a27e93bee9bb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 12 23:21:20.452532 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:20.881039 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-23b020b1-80de-49ea-b5a6-18f16c361c05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:20.906324 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-23b020b1-80de-49ea-b5a6-18f16c361c05 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.446906 Sep 12 23:21:20.906863 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:21:20.919507 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-149ea06b-cdb4-49b1-8633-23ffcc29f55b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:20.945462 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-149ea06b-cdb4-49b1-8633-23ffcc29f55b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030185 Sep 12 23:21:20.946027 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Sep 12 23:21:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:23.497151 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-23b020b1-80de-49ea-b5a6-18f16c361c05 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:23.498276 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-23b020b1-80de-49ea-b5a6-18f16c361c05 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Sep 12 23:21:23.498798 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:23.928373 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-9cad1555-e8c8-40b0-b53e-d539c4729326 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "2", "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:23.947520 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-9cad1555-e8c8-40b0-b53e-d539c4729326 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442132 Sep 12 23:21:23.948107 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:21:23.961069 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-dbdc8b39-b3b6-403e-b081-3ca3fbe69d59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:23.987751 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-dbdc8b39-b3b6-403e-b081-3ca3fbe69d59 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030846 Sep 12 23:21:23.988947 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Sep 12 23:21:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:26.575835 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-9cad1555-e8c8-40b0-b53e-d539c4729326 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:26.576859 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-9cad1555-e8c8-40b0-b53e-d539c4729326 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 12 23:21:26.577264 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:26.952839 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-a198d7fa-29d1-4c42-a877-c23d2642f176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:26.974269 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-a198d7fa-29d1-4c42-a877-c23d2642f176 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.390811 Sep 12 23:21:26.979880 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:21:26.987237 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-e868348f-7dd2-488b-a2ad-e97efc6cceb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:27.015544 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-e868348f-7dd2-488b-a2ad-e97efc6cceb2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032347 Sep 12 23:21:27.016471 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Sep 12 23:21:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:29.639773 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-a198d7fa-29d1-4c42-a877-c23d2642f176 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:29.640979 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-a198d7fa-29d1-4c42-a877-c23d2642f176 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Sep 12 23:21:29.641854 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:30.188494 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-a999d6bb-fcb4-450b-a4f7-a33221fe69cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:30.194884 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:30.212515 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-a999d6bb-fcb4-450b-a4f7-a33221fe69cc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.563750 Sep 12 23:21:30.213700 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:21:30.225678 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-b2f0ce50-0404-4178-bba4-f64e427778a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:30.251301 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-b2f0ce50-0404-4178-bba4-f64e427778a1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029333 Sep 12 23:21:30.251952 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Sep 12 23:21:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:32.866717 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-a999d6bb-fcb4-450b-a4f7-a33221fe69cc admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:32.867775 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-a999d6bb-fcb4-450b-a4f7-a33221fe69cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 12 23:21:32.868338 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:33.338618 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-cb1f98f2-76fa-44b8-8165-f1bd78439dbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:33.345148 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:33.365086 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-cb1f98f2-76fa-44b8-8165-f1bd78439dbc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.490516 Sep 12 23:21:33.365968 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Mon Sep 12 23:21:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:21:33.378071 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-4f9cfa2f-a1d4-459c-89fe-0c5ae8df7dbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:21:33.411750 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-4f9cfa2f-a1d4-459c-89fe-0c5ae8df7dbf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037488 Sep 12 23:21:33.423615 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Mon Sep 12 23:21:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:21:52.721984 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-cb1f98f2-76fa-44b8-8165-f1bd78439dbc admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:52.723064 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-cb1f98f2-76fa-44b8-8165-f1bd78439dbc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 12 23:21:52.723470 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:52.733848 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:21:53.112103 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-cbc0f5dc-c74d-45d3-a48e-9e2cd1d6cd46 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:53.130553 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-cbc0f5dc-c74d-45d3-a48e-9e2cd1d6cd46 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401224 Sep 12 23:21:53.131078 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Sep 12 23:21:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:21:54.442502 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-cb1f98f2-76fa-44b8-8165-f1bd78439dbc admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:54.443516 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-cb1f98f2-76fa-44b8-8165-f1bd78439dbc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 12 23:21:54.443946 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:54.973770 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-dbb4f1ba-5a9d-4594-9cd3-5f819eb93fc7 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:54.978978 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.wsgi [None req-dbb4f1ba-5a9d-4594-9cd3-5f819eb93fc7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-dbb4f1ba-5a9d-4594-9cd3-5f819eb93fc7 admin admin] Request method failure captured: Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Accept: application/json Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Accept-Encoding: gzip, deflate Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Connection: keep-alive Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Content-Length: 0 Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Host: 10.222.0.27 Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Openstack-Api-Version: compute 2.92 Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Openstack-System-Scope: None Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: User-Agent: python-novaclient Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Auth-Token: gAAAAABjH78SenobYnpzEVQ-MkkDM17Qh2Of9uJmAHNmtLSunAGKBVKOMxifaL6TE_sZdMzGDuLb2Wdh45wH01TbKFzZExNY1fpSpNgQoK437RaOsfhOCgEWWRxM-qDTSKERner4irKNmrJmmXRNu-SoyprWuMBIrp58VXamBmm8FldPXpRHsjI Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Domain-Id: None Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Domain-Name: None Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Identity-Status: Confirmed Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Is-Admin-Project: True Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Domain-Id: default Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Domain-Name: Default Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Name: admin Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Role: reader,member,admin Sep 12 23:21:54.982184 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Roles: reader,member,admin Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b515d316021473bab5135bffb78aaff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b515d316021473bab5135bffb78aaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}] Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant: admin Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant-Name: admin Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User: admin Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Domain-Id: default Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Domain-Name: Default Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Id: 318df21351594db286347c68d09ec473 Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Name: admin Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: method: > Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: exception: Flavor 42 could not be found. Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: action_args: {'id': '42'} Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:21:54.983703 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:54.984598 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:54.985808 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-dbb4f1ba-5a9d-4594-9cd3-5f819eb93fc7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:21:54.986857 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-dbb4f1ba-5a9d-4594-9cd3-5f819eb93fc7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399276 Sep 12 23:21:54.986857 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Sep 12 23:21:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:54.993920 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-96d12e42-f164-44a4-9bc2-b8a97234a927 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:55.016395 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-96d12e42-f164-44a4-9bc2-b8a97234a927 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026020 Sep 12 23:21:55.016923 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Sep 12 23:21:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:21:55.028138 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-cd157246-36a3-4452-bfb6-8c8c88c367a3 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:55.050010 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-cd157246-36a3-4452-bfb6-8c8c88c367a3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026604 Sep 12 23:21:55.050532 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Sep 12 23:21:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:21:55.059841 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-df67d2d2-5da4-4fbd-a510-feed5f682867 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:55.065094 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.wsgi [None req-df67d2d2-5da4-4fbd-a510-feed5f682867 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-df67d2d2-5da4-4fbd-a510-feed5f682867 admin admin] Request method failure captured: Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Accept: application/json Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Accept-Encoding: gzip, deflate Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Connection: keep-alive Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Content-Length: 0 Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Host: 10.222.0.27 Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Openstack-Api-Version: compute 2.92 Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Openstack-System-Scope: None Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: User-Agent: python-novaclient Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Auth-Token: gAAAAABjH78SenobYnpzEVQ-MkkDM17Qh2Of9uJmAHNmtLSunAGKBVKOMxifaL6TE_sZdMzGDuLb2Wdh45wH01TbKFzZExNY1fpSpNgQoK437RaOsfhOCgEWWRxM-qDTSKERner4irKNmrJmmXRNu-SoyprWuMBIrp58VXamBmm8FldPXpRHsjI Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Domain-Id: None Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Domain-Name: None Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Identity-Status: Confirmed Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Is-Admin-Project: True Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Domain-Id: default Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Domain-Name: Default Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Name: admin Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Role: reader,member,admin Sep 12 23:21:55.068386 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Roles: reader,member,admin Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b515d316021473bab5135bffb78aaff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b515d316021473bab5135bffb78aaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}] Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant: admin Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant-Name: admin Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User: admin Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Domain-Id: default Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Domain-Name: Default Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Id: 318df21351594db286347c68d09ec473 Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Name: admin Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: method: > Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: exception: Flavor 42 could not be found. Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: action_args: {'id': '42'} Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:21:55.069885 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:55.070851 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:55.071971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-df67d2d2-5da4-4fbd-a510-feed5f682867 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:21:55.072973 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-df67d2d2-5da4-4fbd-a510-feed5f682867 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013484 Sep 12 23:21:55.072973 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Sep 12 23:21:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:56.287589 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-cd157246-36a3-4452-bfb6-8c8c88c367a3 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:56.288608 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-cd157246-36a3-4452-bfb6-8c8c88c367a3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 12 23:21:56.289007 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:56.810661 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-8cc0199b-477d-4d25-a07b-abaa7afee53b admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:56.815688 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.wsgi [None req-8cc0199b-477d-4d25-a07b-abaa7afee53b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-8cc0199b-477d-4d25-a07b-abaa7afee53b admin admin] Request method failure captured: Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Accept: application/json Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Accept-Encoding: gzip, deflate Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Connection: keep-alive Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Content-Length: 0 Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Host: 10.222.0.27 Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Openstack-Api-Version: compute 2.92 Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Openstack-System-Scope: None Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: User-Agent: python-novaclient Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Auth-Token: gAAAAABjH78UADiFToYm2RfPopdFOvF_EbBWvEcUJLtETP4Djs2_-tM987kr7h4AgiV2XGOoqkNuzfrngDxKvFRbDTIHR7YA9c87Mel3TxjuN7jxRy-f0BtRUreeVdbgeq3zZeNRNcAdAEQZcqTJlUrIoYV3nipLwzDZryT_12X6XRQujP9Z8Jk Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Domain-Id: None Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Domain-Name: None Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Identity-Status: Confirmed Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Is-Admin-Project: True Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Domain-Id: default Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Domain-Name: Default Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Name: admin Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Role: reader,member,admin Sep 12 23:21:56.817715 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Roles: reader,member,admin Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b515d316021473bab5135bffb78aaff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b515d316021473bab5135bffb78aaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}] Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant: admin Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant-Name: admin Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User: admin Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Domain-Id: default Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Domain-Name: Default Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Id: 318df21351594db286347c68d09ec473 Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Name: admin Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: method: > Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: exception: Flavor 84 could not be found. Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: action_args: {'id': '84'} Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:21:56.819242 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:56.820235 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.821591 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-8cc0199b-477d-4d25-a07b-abaa7afee53b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:21:56.822673 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-8cc0199b-477d-4d25-a07b-abaa7afee53b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392552 Sep 12 23:21:56.822673 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Sep 12 23:21:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:56.828863 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-351213b2-575e-49fd-88d1-d6efa52ae35d admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:56.844643 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-351213b2-575e-49fd-88d1-d6efa52ae35d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019227 Sep 12 23:21:56.845211 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Sep 12 23:21:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:21:56.854937 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-e4140ac9-3db7-45f5-83c1-36e0b564aa6d admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:56.870230 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-e4140ac9-3db7-45f5-83c1-36e0b564aa6d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018877 Sep 12 23:21:56.870766 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Sep 12 23:21:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:21:56.880677 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-222b28d8-62f0-4be9-b124-d314cbaf1128 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:56.885760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.wsgi [None req-222b28d8-62f0-4be9-b124-d314cbaf1128 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-222b28d8-62f0-4be9-b124-d314cbaf1128 admin admin] Request method failure captured: Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Accept: application/json Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Accept-Encoding: gzip, deflate Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Connection: keep-alive Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Content-Length: 0 Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Host: 10.222.0.27 Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Openstack-Api-Version: compute 2.92 Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Openstack-System-Scope: None Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: User-Agent: python-novaclient Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Auth-Token: gAAAAABjH78UADiFToYm2RfPopdFOvF_EbBWvEcUJLtETP4Djs2_-tM987kr7h4AgiV2XGOoqkNuzfrngDxKvFRbDTIHR7YA9c87Mel3TxjuN7jxRy-f0BtRUreeVdbgeq3zZeNRNcAdAEQZcqTJlUrIoYV3nipLwzDZryT_12X6XRQujP9Z8Jk Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Domain-Id: None Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Domain-Name: None Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Identity-Status: Confirmed Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Is-Admin-Project: True Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Domain-Id: default Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Domain-Name: Default Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Name: admin Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Role: reader,member,admin Sep 12 23:21:56.887262 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Roles: reader,member,admin Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b515d316021473bab5135bffb78aaff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b515d316021473bab5135bffb78aaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}] Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant: admin Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant-Name: admin Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User: admin Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Domain-Id: default Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Domain-Name: Default Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Id: 318df21351594db286347c68d09ec473 Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Name: admin Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: method: > Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: exception: Flavor 84 could not be found. Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: action_args: {'id': '84'} Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:21:56.888888 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:56.889937 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:56.891344 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-222b28d8-62f0-4be9-b124-d314cbaf1128 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:21:56.892621 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-222b28d8-62f0-4be9-b124-d314cbaf1128 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012103 Sep 12 23:21:56.892621 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Sep 12 23:21:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 12 23:21:58.100570 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-e4140ac9-3db7-45f5-83c1-36e0b564aa6d admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:58.101574 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-e4140ac9-3db7-45f5-83c1-36e0b564aa6d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 12 23:21:58.101964 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:21:58.619729 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-a77fa0ed-5b37-4ada-8a18-13526a5325a8 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:58.625594 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.wsgi [None req-a77fa0ed-5b37-4ada-8a18-13526a5325a8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-a77fa0ed-5b37-4ada-8a18-13526a5325a8 admin admin] Request method failure captured: Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Accept: application/json Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Accept-Encoding: gzip, deflate Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Connection: keep-alive Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Content-Length: 0 Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Host: 10.222.0.27 Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Openstack-Api-Version: compute 2.92 Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Openstack-System-Scope: None Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: User-Agent: python-novaclient Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Auth-Token: gAAAAABjH78WGyg12RC1RM8MGycDN3RaE6VeVMY4vpjj4rBYVsU8mf33IxXj05UVrHNRL7_kLXBOKMidJ5W2B3XJ55MAQiRMZ9j01WJRcQm2i0sf_GEIlECCQpDaAlr6JnSfIr0GGYXhoMCapV_Sq7b11QSl7NXfkcNPpLpSmDlJ2vOmzNgRjoE Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Domain-Id: None Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Domain-Name: None Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Identity-Status: Confirmed Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Is-Admin-Project: True Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Domain-Id: default Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Domain-Name: Default Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Project-Name: admin Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Role: reader,member,admin Sep 12 23:21:58.627117 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Roles: reader,member,admin Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b515d316021473bab5135bffb78aaff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b515d316021473bab5135bffb78aaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}] Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant: admin Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-Tenant-Name: admin Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User: admin Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Domain-Id: default Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Domain-Name: Default Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Id: 318df21351594db286347c68d09ec473 Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: X-User-Name: admin Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: method: > Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: exception: Flavor 451 could not be found. Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: action_args: {'id': '451'} Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:21:58.628760 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:58.630384 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.631926 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-a77fa0ed-5b37-4ada-8a18-13526a5325a8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:21:58.633216 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-a77fa0ed-5b37-4ada-8a18-13526a5325a8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392102 Sep 12 23:21:58.633216 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Sep 12 23:21:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:21:58.638896 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-09fdfa28-83ab-45ea-9a50-bb5f8bd3470b admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:58.653876 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-09fdfa28-83ab-45ea-9a50-bb5f8bd3470b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018582 Sep 12 23:21:58.654404 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Sep 12 23:21:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:21:58.663744 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:58.678719 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018487 Sep 12 23:21:58.679232 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Sep 12 23:21:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:21:58.688223 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-3378cd32-061b-47f2-9813-957bc74fa091 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:58.693739 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.wsgi [None req-3378cd32-061b-47f2-9813-957bc74fa091 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-3378cd32-061b-47f2-9813-957bc74fa091 admin admin] Request method failure captured: Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Accept: application/json Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Accept-Encoding: gzip, deflate Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Connection: keep-alive Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Content-Length: 0 Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Host: 10.222.0.27 Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Openstack-Api-Version: compute 2.92 Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Openstack-System-Scope: None Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: User-Agent: python-novaclient Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Auth-Token: gAAAAABjH78WGyg12RC1RM8MGycDN3RaE6VeVMY4vpjj4rBYVsU8mf33IxXj05UVrHNRL7_kLXBOKMidJ5W2B3XJ55MAQiRMZ9j01WJRcQm2i0sf_GEIlECCQpDaAlr6JnSfIr0GGYXhoMCapV_Sq7b11QSl7NXfkcNPpLpSmDlJ2vOmzNgRjoE Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Domain-Id: None Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Domain-Name: None Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Identity-Status: Confirmed Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Is-Admin-Project: True Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Domain-Id: default Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Domain-Name: Default Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Project-Name: admin Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Role: reader,member,admin Sep 12 23:21:58.695218 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Roles: reader,member,admin Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5b515d316021473bab5135bffb78aaff", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5b515d316021473bab5135bffb78aaff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5b515d316021473bab5135bffb78aaff"}]}] Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant: admin Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant-Id: 5b515d316021473bab5135bffb78aaff Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-Tenant-Name: admin Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User: admin Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Domain-Id: default Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Domain-Name: Default Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Id: 318df21351594db286347c68d09ec473 Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: X-User-Name: admin Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: method: > Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: exception: Flavor 451 could not be found. Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: action_args: {'id': '451'} Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:21:58.696824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:58.697846 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: ERROR nova.api.openstack.wsgi Sep 12 23:21:58.699132 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-3378cd32-061b-47f2-9813-957bc74fa091 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:21:58.700458 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-3378cd32-061b-47f2-9813-957bc74fa091 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011810 Sep 12 23:21:58.700458 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Sep 12 23:21:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 12 23:21:59.904711 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:21:59.905751 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 12 23:21:59.906134 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:22:00.418855 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-94ffff10-713f-486a-bba8-63e718b878c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:22:00.437913 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-94ffff10-713f-486a-bba8-63e718b878c3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.394585 Sep 12 23:22:00.438458 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Sep 12 23:22:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:22:01.658342 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:22:01.659395 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 12 23:22:01.659827 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:22:02.177313 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-47abb42b-fe1f-45ac-8a65-df18feedb281 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:22:02.195701 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-47abb42b-fe1f-45ac-8a65-df18feedb281 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401864 Sep 12 23:22:02.196309 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Sep 12 23:22:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:22:03.406786 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:22:03.407823 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 12 23:22:03.408212 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:22:03.932678 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-dab6944a-14c3-4e52-bc16-5d0614d49fcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:22:03.951712 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-dab6944a-14c3-4e52-bc16-5d0614d49fcf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406301 Sep 12 23:22:03.952272 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Sep 12 23:22:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:22:05.169306 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:22:05.170317 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 12 23:22:05.170709 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:22:05.690723 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-a64d95fc-7f74-46f3-bf00-ac4d17e2f008 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:22:05.710372 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-a64d95fc-7f74-46f3-bf00-ac4d17e2f008 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.401146 Sep 12 23:22:05.710911 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Sep 12 23:22:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:22:06.909849 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:22:06.909849 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 12 23:22:06.910413 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:22:07.432122 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-d64964d9-9b1f-4205-9acd-8e4956925d65 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:22:07.452770 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-d64964d9-9b1f-4205-9acd-8e4956925d65 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.408037 Sep 12 23:22:07.453307 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Sep 12 23:22:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:23:03.834786 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:23:03.835862 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-ccf2d24f-2e75-4a7c-8f34-29d90ba56c40 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 12 23:23:03.836271 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Mon Sep 12 23:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:23:03.846700 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:04.219661 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-9add6ce6-d7b2-4792-aa6c-d51753a62034 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:23:04.240053 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-9add6ce6-d7b2-4792-aa6c-d51753a62034 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397800 Sep 12 23:23:04.240589 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Mon Sep 12 23:23:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:23:04.262180 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_api:SELECT=14 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:23:04.265836 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-97baaf0c-89dd-421f-96bb-6881159438ff admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:23:04.273130 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-97baaf0c-89dd-421f-96bb-6881159438ff admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012547 Sep 12 23:23:04.273642 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Sep 12 23:23:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:23:04.285789 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-94554cf4-b55a-455b-90f8-0162357dc359 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:23:04.292925 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-94554cf4-b55a-455b-90f8-0162357dc359 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011231 Sep 12 23:23:04.293428 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Sep 12 23:23:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:23:04.305047 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:23:04.311956 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010292 Sep 12 23:23:04.312462 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Mon Sep 12 23:23:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:23:04.323402 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-51161536-effe-46b7-bd63-d2ef7da03d44 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:23:04.330412 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-51161536-effe-46b7-bd63-d2ef7da03d44 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010461 Sep 12 23:23:04.330911 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Mon Sep 12 23:23:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:26:02.151292 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:02.152340 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 12 23:26:02.152729 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:26:02.293620 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_api:SELECT=6 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:02.457613 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:02.462868 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:02.463352 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:02.463824 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:02.464544 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:02.464996 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:02.465419 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:02.496898 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-f73f7684-8949-446a-b87a-a52822dcee4a admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.204496 Sep 12 23:26:02.497455 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Sep 12 23:26:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:26:03.591952 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:03.592996 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 12 23:26:03.593389 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:26:03.782346 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:03.785773 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:03.786250 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:03.786680 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:03.787971 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:03.788420 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:03.788836 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:03.807843 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-680e48c8-23df-4ba2-997c-587a5df71642 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076217 Sep 12 23:26:03.808326 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Sep 12 23:26:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:26:15.303173 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:15.304277 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Sep 12 23:26:15.304673 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:26:15.448123 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_cell0:SELECT=4 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:15.448841 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_cell1:SELECT=4 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:15.449444 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG dbcounter [-] [105434] Writing DB stats nova_api:SELECT=8 {{(pid=105434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:26:15.497728 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:15.501139 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:15.501611 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:15.502037 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:15.502741 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:15.503183 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:15.503621 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:15.528202 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-f738214a-918a-46e8-8b49-4fe1f43a0db4 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084443 Sep 12 23:26:15.528877 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Sep 12 23:26:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:26:16.616990 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG nova.api.openstack.wsgi [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] Calling method '>' {{(pid=105435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:16.617996 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: INFO nova.api.openstack.requestlog [None req-afe47008-7731-4639-b507-396ee9faa40b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 12 23:26:16.618387 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: [pid: 105435|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Sep 12 23:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:26:16.810872 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG nova.api.openstack.wsgi [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] Calling method '>' {{(pid=105434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:26:16.814304 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:16.814781 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:16.815243 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:16.815986 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:26:16.816436 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:26:16.816868 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: DEBUG oslo_concurrency.lockutils [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:26:16.838481 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: INFO nova.api.openstack.requestlog [None req-b2777498-cb94-4334-94b2-c370f2e8bb62 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.077636 Sep 12 23:26:16.838967 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: [pid: 105434|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Sep 12 23:26:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:27:13.209160 dv-cinder-852009-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 12 23:27:13.209666 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: Mon Sep 12 23:27:13 2022 - graceful shutdown triggered... Sep 12 23:27:13.210121 dv-cinder-852009-7-iscsi devstack@n-api.service[105434]: Gracefully killing worker 1 (pid: 105434)... Sep 12 23:27:13.211058 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: Gracefully killing worker 2 (pid: 105435)... Sep 12 23:27:13.337274 dv-cinder-852009-7-iscsi devstack@n-api.service[105435]: DEBUG dbcounter [-] [105435] Writing DB stats nova_api:SELECT=4 {{(pid=105435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:14.210145 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: worker 1 buried after 1 seconds Sep 12 23:27:14.210680 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: worker 2 buried after 1 seconds Sep 12 23:27:14.210680 dv-cinder-852009-7-iscsi devstack@n-api.service[105433]: goodbye to uWSGI. Sep 12 23:27:14.211757 dv-cinder-852009-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 12 23:27:14.212296 dv-cinder-852009-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 12 23:27:14.215093 dv-cinder-852009-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 23:27:14.227258 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 23:27:14 2022] *** Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: nodename: dv-cinder-852009-7-iscsi Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: machine: x86_64 Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: clock source: unix Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: pcre jit disabled Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: detected number of CPU cores: 4 Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: current working directory: / Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: detected binary path: /usr/bin/uwsgi-core Sep 12 23:27:14.229328 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: your processes number limit is 47680 Sep 12 23:27:14.230082 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: your memory page size is 4096 bytes Sep 12 23:27:14.230082 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: detected max file descriptor number: 2048 Sep 12 23:27:14.230082 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: lock engine: pthread robust mutexes Sep 12 23:27:14.230082 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: thunder lock: enabled Sep 12 23:27:14.230082 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 23:27:14.230082 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 23:27:14.268783 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: Python main interpreter initialized at 0x555618e359c0 Sep 12 23:27:14.268783 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: python threads support enabled Sep 12 23:27:14.268783 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: your server socket listen backlog is limited to 100 connections Sep 12 23:27:14.268783 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: your mercy for graceful operations on workers is 90 seconds Sep 12 23:27:14.269178 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 23:27:14.269738 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: *** Operational MODE: preforking *** Sep 12 23:27:14.269989 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: *** uWSGI is running in multiple interpreter mode *** Sep 12 23:27:14.269989 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: spawned uWSGI master process (pid: 120606) Sep 12 23:27:14.270209 dv-cinder-852009-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 23:27:14.270755 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: spawned uWSGI worker 1 (pid: 120621, cores: 1) Sep 12 23:27:14.271104 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: spawned uWSGI worker 2 (pid: 120622, cores: 1) Sep 12 23:27:14.271415 dv-cinder-852009-7-iscsi devstack@n-api.service[120606]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 23:27:14.938454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:27:14.939005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:27:16.092135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:27:16.092135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: from cryptography.utils import int_from_bytes Sep 12 23:27:16.092870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:27:16.092870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: from cryptography.utils import int_from_bytes Sep 12 23:27:16.093866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:27:16.093866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: from cryptography.utils import int_from_bytes Sep 12 23:27:16.094315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:27:16.094315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: from cryptography.utils import int_from_bytes Sep 12 23:27:18.544775 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:27:18.545341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:27:18.546390 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:27:18.546390 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:27:18.546390 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:27:18.546829 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.546919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.547183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.547517 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.547870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.548190 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.548506 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.548823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.549150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.549409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.549726 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.550203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-7-iscsi {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.550563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.550874 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.551185 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.551505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.551842 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.552168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.552479 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.552985 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.553438 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.553740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.554056 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.554396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.554716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.555025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.555345 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.555678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.556003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.556315 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.556622 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:27:18.557006 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-7-iscsi {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.557113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:27:18.557206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.557321 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.557413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:27:18.557639 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.557752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:27:18.558008 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:27:18.558104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.558397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.558496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.558727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.558828 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.559051 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.559157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.559378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.559470 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.559716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.559828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.560048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.560156 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.560370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.560460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.560690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.560825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.561011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.561117 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.561269 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.561359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.561586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.561692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.561907 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.562038 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852009-7-iscsi {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.562226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.562365 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.562533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.562679 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.562840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.562996 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.563086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.563319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.563423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.563658 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.563791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.563990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.564105 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.564301 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.564424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.564601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.564809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.564924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.565124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.565231 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.565433 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.565530 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.565745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.565844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.566567 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.566677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.566878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.566977 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.567188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.567280 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.567496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.567695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.567845 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.568057 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.568177 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.568276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.568427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.568545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.568859 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.568963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852009-7-iscsi {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.569196 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.569307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.569522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.570415 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.570525 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.570609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.570711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.570806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.570892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.570987 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571228 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.571911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.572077 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.572172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.572348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.572525 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.572692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.572787 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.573014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.575743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.575887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576017 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576244 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576818 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.576983 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577111 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577231 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577350 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577577 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577818 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.577935 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.578881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.579106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.579230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.579767 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.579903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.580016 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.580161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.580277 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.580387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.580505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.580624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.580943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.581078 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.581190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.581306 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.581424 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.581543 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.582247 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.582374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.582492 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.582610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.582729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.582846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.582972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.583092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.583247 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.583378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.583488 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.583641 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.583766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.583876 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.584008 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.584150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.584301 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.584504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.584645 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.584782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.584911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585311 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.585984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.586111 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.586248 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.586382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.586522 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.586658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.586788 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.586922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.587058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.587193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.587338 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.587474 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.587788 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.587919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588047 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588174 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588311 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588585 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588720 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588856 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.588990 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.589133 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.589266 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.589415 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.589907 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.590093 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.590230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.590371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.590510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.590647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.590782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.590934 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.591139 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.591277 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.591405 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.591532 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.591685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.591815 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.591956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.592087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.592226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.592355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.592491 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.592619 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.592754 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.592883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.593018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.593154 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.593319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.593459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.593596 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.593726 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.593726 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.593974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.594113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.594240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.594375 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.594524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.594729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.594861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.594988 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.595116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.595255 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.595389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.595530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.595709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.595847 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.595976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.596130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.596266 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.596409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.596537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.596673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.596801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.596935 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.597071 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.597213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.597348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.597477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.597605 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.597752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.597894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.598031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.598166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.598336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.598476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.598611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.598748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.598876 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.599010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.599139 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.599271 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.599406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.599543 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.600072 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.600213 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.600350 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.600487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.600616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.600616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.600881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.601010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.601159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.601361 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.601565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.601705 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.601847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.601986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.602114 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.602249 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.602377 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.602505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.602641 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.602787 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:27:18.602924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.603060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.603189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.603371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.603504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.603504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.603793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.603929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.604064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.604205 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.604341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.604468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.604592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.604726 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.604917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605270 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605377 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605491 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605729 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.605947 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606063 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606293 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606511 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606618 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606735 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606843 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.606971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.607082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.607190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.607306 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.607423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.607539 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.607712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.607882 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.608011 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.608145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.608283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.608411 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.608588 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.608721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.608914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.609052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.609231 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.609376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.609578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.609725 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.610214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.610354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.610495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.610638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.610776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.610907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.611042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.611171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.611303 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.611518 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.611671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.611811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.611941 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.612084 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.612213 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.612353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.612489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.612628 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.612764 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.612903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.613041 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.613177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.613313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.613486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.613623 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.613774 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.613920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.614098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.614229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.614413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.614554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.614731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.614886 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.615088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.615226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.615355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.615489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.615685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.615835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.616002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.616145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.616330 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.616461 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.616652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.616793 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.616958 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.617098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.617278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.617415 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.617597 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.617728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.617913 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.618042 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.618218 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.618341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.618526 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.618651 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.618828 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.618953 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.619134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.619251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.619437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.619559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.619768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.619927 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.620412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.620589 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.620713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.620840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621207 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621620 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.621972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622091 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622210 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622334 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622571 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622789 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.622911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.623048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.623175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.623354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.623523 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.623724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.623870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.624062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.624200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.624371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.624502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.624738 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.624911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.625075 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.625293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.625454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.625605 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.625777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.625920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.626060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.626209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.626357 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.626509 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.626509 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.626870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.626870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.627154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.627154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.627439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.627634 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.627785 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.627785 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.628058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.628058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.628335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.629010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.629234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.629486 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.629766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.630004 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.630759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.630979 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.631328 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.631540 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.631761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.631761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.632047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.632190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.632330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.632478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.632619 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.632797 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.632957 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.633106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.633247 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.633605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.633767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.633940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.634084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.634233 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.634382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.634532 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.634674 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.635015 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.635166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.635323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.635546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.635725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.635893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.636050 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.636202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.636345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.636494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.636643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.636791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.636941 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.637095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.637245 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.637427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.637577 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.637728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.637881 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.638028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.638170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.638318 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.638459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.638613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.638755 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.638902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.639051 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.639199 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.639347 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.639502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.639676 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.639818 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.639969 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.640128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.640296 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.640677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.640910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.641153 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.641317 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.641526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.641686 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.641828 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.641969 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.642128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.642277 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.642420 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.642581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.642723 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.642870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.643019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.643168 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.643308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.643459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.643668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.643836 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.643988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.644175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.644826 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.645070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.645226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.645367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.645534 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.645886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.646079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.646252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.646397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.646546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.646694 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.646835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.647001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.647151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.647292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.647433 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.647594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.647743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.647900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.648042 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.648191 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.648331 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.648471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.648612 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.648765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.648925 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.649066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.649206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.649355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.649495 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.649645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.649787 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.649934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.650081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.650236 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.650386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.650546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.650915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.651166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.651394 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.651678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.651851 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.651995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.652135 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.652276 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.652416 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.652555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.652709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.652887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.653046 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.653207 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.653349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.653490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.653645 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.653829 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.653984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.654126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.654266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.654421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.654571 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.654712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.654852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.655001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.655251 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.655407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.655549 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.655729 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.655939 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.656349 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.656504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.656662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.656805 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.656805 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.657082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.657229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.657370 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.657541 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.657691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.657831 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.657971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.658114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.658336 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.658489 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.658650 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.658802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.658952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.659102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.659243 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.659393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.659533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.659778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.659934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.660083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.660229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.660370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.660519 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.660669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.661038 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.661288 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.661531 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.661681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.661915 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.662073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.662217 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.662367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.662515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.662657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.662805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.662956 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.663097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.663237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.663378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.663518 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.663682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.663892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.664039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.664189 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.664338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.664487 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.664636 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.664778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.664918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.665065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.665231 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.665449 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.665609 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.665753 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.665929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.666150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.666297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.666447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.666601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.666743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.666890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.667031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.667179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.667320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.667474 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.667647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.667811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.667954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.668166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.668323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.668465 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.668465 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.668741 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.668889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.669038 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.669192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.669342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.669483 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.669632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.669784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.669925 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.670082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.670242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.670386 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.670535 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.670679 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.670826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.671193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.671451 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.671737 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.671915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.672137 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.672301 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.672444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.672600 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.672743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.672898 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.673040 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.673181 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.673330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.673478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.673620 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.673773 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.673969 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.674126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.674274 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.674416 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.674575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.674717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.674867 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.675017 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.675158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.675298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.675494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.675743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.675930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.676077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.676322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.676479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.676630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.676773 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.676915 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.677103 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.677256 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.677407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.677562 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.677711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.677861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.678004 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.678144 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.678305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.678448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.678598 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.678740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.678889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.679040 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.679191 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.679333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.679483 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.679669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.679669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.679944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.680104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.680420 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.680585 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.680737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.680879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.681034 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.681413 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.681671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.681922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.682070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.682301 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.682497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.682643 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.682804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.682947 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.683103 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.683247 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.683400 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.683550 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.683728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.683879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.684062 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.684209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.684366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.684516 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.684657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.684809 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.684958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.685109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.685252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.685402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.685544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.685710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.685926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.686084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.686226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.686460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.686609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.686759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.686917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.687074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.687254 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.687407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.687550 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.688342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.688497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.688654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.688804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.688952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.689101 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.689250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.689398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.689560 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.689703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.689850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.690037 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.690201 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.690411 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.690564 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.690706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.690861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.691883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.692132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.692309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.692521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.692680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.692823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.692972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.693122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.693278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.693421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.693570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.693713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.693869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.694019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.694215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.694215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.694493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.694493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.694781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.694781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.695069 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.695210 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.695360 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.695360 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.695657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.695819 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.696060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.696209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.696558 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.696723 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.696879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.697031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.697174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.697323 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.697472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.697614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.697762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.697762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.698048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.698198 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.698378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.698525 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.698741 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.698893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.699080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.699242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.699393 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.699535 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.699743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.699743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700039 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700337 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700337 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700632 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700794 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.700943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.701218 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.701359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.701512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.701989 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.702171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.702542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.702764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.702921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.703065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.703221 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.703371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.703513 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.703706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.703864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.704017 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.704215 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.704367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.704518 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.704668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.704818 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.704971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.705112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.705272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.705423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.705572 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.705727 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.705869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.705869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.706248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.706404 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.706630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.707345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.707503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.707690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.707926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.708106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.708297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.708449 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.708591 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.708731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.708878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.709019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.709173 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.709323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.709474 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.709625 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.709779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.709963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.710150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.710300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.710456 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.710618 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.710770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.710935 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.711084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.711230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.711385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.711551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.712088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.712337 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.712492 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.712768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.712768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.715502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.715710 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.715880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.716035 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.716192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.716441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.716597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.716748 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.716907 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.717094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.717263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.717499 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.717654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.717818 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.717976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.718134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.718282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.718437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.718585 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.718741 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.718899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.719049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.719197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.719371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.719521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.719706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.719856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.720012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.720169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.720319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.720475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.720643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.720800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.720949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.721104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.721261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.721429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.721585 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.721741 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.721913 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.722314 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.722565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.722767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723258 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723814 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.723980 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724281 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724579 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724886 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.724968 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725121 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725243 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725330 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725418 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725578 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725578 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725876 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.725955 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726098 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726176 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726255 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726328 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726414 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726653 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726734 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726807 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726877 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.726947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727017 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.727962 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728434 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.728812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729135 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729213 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729291 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729363 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729517 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729656 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729794 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729871 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.729943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730324 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730871 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.730949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731090 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731317 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731395 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731687 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.731960 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732148 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732442 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732553 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732825 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.732917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733280 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733366 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733631 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.733971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734061 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734636 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734636 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734797 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.734881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.735073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.735191 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.735454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.735558 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.735933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.736033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.736396 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.736508 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.736845 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.736943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.737802 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.738425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.738425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.738594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.738594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.738760 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.739042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.739143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.739489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.739612 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.739964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.740065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.740411 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.740510 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.740854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.740953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.741297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.741397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.741735 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.741834 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.742188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.742282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.742628 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.742724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.743060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.743165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.743520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.743667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.743984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.744079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.744448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.744562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.744856 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.744953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.745290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.745424 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.745769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.745882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.746161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.746265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.746597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.746698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.747042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.747143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.747476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.747597 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.747952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.748071 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.748383 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.748486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.748822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.748922 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.749259 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.749360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.749704 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.749798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.750160 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.750261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.750614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.750715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.751051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.751151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.751489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.751602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.751956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.752058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.752652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.752767 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.753030 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.753144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.754090 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.754214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.754528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.754632 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.754979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.755079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.755440 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.755553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.755972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.756083 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.756417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.756516 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.756860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.756963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.757300 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.757400 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.757737 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.757830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.758172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.758288 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.758600 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.758694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.759044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.759137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.759476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.759589 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.759943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.760037 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.760422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.760521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.760872 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.760966 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.761323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.761570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.761818 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.762053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.762275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.762509 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.762804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.762950 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.763169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.763410 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.763666 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.763880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.764109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.764317 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.764562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.764764 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.765013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.765211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.765466 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.765611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.766012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.766127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.766361 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.766455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.766803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.766895 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.767250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.767345 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.767703 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.767812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.768182 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.768299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.768570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.768671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.769004 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.769137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.769481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.769584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.769930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.770023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.770359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.770460 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.770789 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.771081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.771237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.771529 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.771716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.772022 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.772114 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.772482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.772576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.772924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.773028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.773331 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.773427 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.773795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.773899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.774192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.774317 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.774708 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.774820 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.775140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.775239 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.775630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.775747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.776056 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.776157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.776484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.776588 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.776922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.777013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.777365 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.777471 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.778061 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.778184 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.778396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.778494 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.778678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.778778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.779123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.779709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.779833 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.779930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.780036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.780391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.780504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.780863 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.780967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.781554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.781655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.782010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.782287 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.782450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.782772 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.783093 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.783199 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.783332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.783693 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.783796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.784149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.784254 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.784641 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.784777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.785028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.785123 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.785472 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.785565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.785923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.786030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.786435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.786540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.786790 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.786881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.787218 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.787312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.787680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.787780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.788132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.788225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.788566 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.788681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.788998 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.789105 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.789429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.789540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.789856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.790036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.790293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.790387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.790724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.790817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.791170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.791325 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.791495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.791729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.791877 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.792020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.792175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.792329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.792495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.792817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.792969 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.793378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.793546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.793732 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.793838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.793933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794027 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794210 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794580 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794699 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.794899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.795013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.795214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.795307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.795544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.795662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.795923 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.796017 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.796234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.796325 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.796567 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.796668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.796884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.796986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.797240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.797333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.797566 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.797658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.797903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.798136 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.798237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.798482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.798581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.798811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.798911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.799156 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.799249 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.799472 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.799611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.799832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.799928 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.800145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.800235 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.801002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.801102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.801334 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.801435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.801641 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.801733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.801952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.802045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.802260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.802359 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.802573 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.802712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.802890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.803005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.803201 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.803302 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.803506 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.803637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.803838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.803963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.804151 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.804274 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.804456 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.804558 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.804762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.804897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.805065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.805162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.805370 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.805480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.805681 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.805784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.805983 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.806107 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.806291 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.806393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.806664 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.806770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.806904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.806996 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.807210 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.807310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.807520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.807641 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.807855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.807987 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.808161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.808253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.808468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.808562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.808774 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.808875 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.809079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.809186 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.809385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.809500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.809719 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.809823 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.810036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.810137 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.810355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.810470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.810679 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.810814 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.810992 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.811141 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.811315 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.811469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.811649 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.811809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.811975 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.812139 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.812299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.812469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.812613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.812789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.812926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.813116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.813261 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.813470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.813574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.813768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.813881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.814132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.814234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.814484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.814612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.814813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.814931 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.815204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.815297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.815462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.815697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.815801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.815907 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.816676 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.816877 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.817004 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.817206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.817322 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.817534 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.817625 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.817859 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.817940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.818179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.818279 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.818497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.818587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.818821 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.818912 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.819198 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.819299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.819437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.819777 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.820095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.820411 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.820733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.820824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.821046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.821140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.824855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.824983 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825182 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825463 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825623 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825696 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825767 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825836 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825913 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.825984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.827689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.827798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.827884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.827884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828038 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828350 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828635 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.828878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829096 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.829899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.831169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.831169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.831169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.831169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.831500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.831828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.832394 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.832736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.833187 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.833588 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.833887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.834303 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.834629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.835081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.835305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.835629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.836065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.836414 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.836879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.837204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.837544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.837884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.838260 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.838833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.839464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.840130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.840480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.840807 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.841167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.841507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.842113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.842664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.842930 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:27:18.843185 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:27:18.894468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Registered counter for database nova_api Sep 12 23:27:18.908785 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO dbcounter [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Registered counter for database nova_api Sep 12 23:27:18.918131 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:18.926086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:18.929367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_db.sqlalchemy.engines [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:18.935832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writer thread running {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:18.982533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.context [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96429caa-1467-4b07-a047-7b6621f3163f(cell1) {{(pid=120621) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:27:18.986631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:27:18.987149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:27:18.989291 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:27:18.990043 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:27:18.990496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:27:18.991589 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.context [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96429caa-1467-4b07-a047-7b6621f3163f(cell1) {{(pid=120622) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:27:18.992528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:27:18.994535 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Registered counter for database nova_cell0 Sep 12 23:27:18.995597 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:27:18.996071 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:27:18.997758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:27:18.998508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:27:18.998603 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Registered counter for database nova_cell1 Sep 12 23:27:18.998961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:27:19.001064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:27:19.003051 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO dbcounter [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Registered counter for database nova_cell0 Sep 12 23:27:19.006428 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:19.007908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO dbcounter [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Registered counter for database nova_cell1 Sep 12 23:27:19.008860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:19.014084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:19.017231 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_db.sqlalchemy.engines [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:19.018012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_db.sqlalchemy.engines [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:19.020085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:19.024916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writer thread running {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:19.026960 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writer thread running {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:19.165162 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Registered counter for database nova_cell0 Sep 12 23:27:19.172677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:19.177976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:19.179889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO dbcounter [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Registered counter for database nova_cell0 Sep 12 23:27:19.187994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_db.sqlalchemy.engines [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:27:19.192420 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writer thread running {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:27:19.504722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:27:19.511972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:27:19.516329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: WARNING keystonemiddleware.auth_token [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:27:19.524218 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: WARNING keystonemiddleware.auth_token [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:27:19.860918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:27:19.866976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-da69c66d-4070-47f5-b3a2-68c81ce4ab3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:27:19.868164 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: WARNING keystonemiddleware.auth_token [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:27:19.872309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555618e359c0 pid: 120621 (default app) Sep 12 23:27:19.874141 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: WARNING keystonemiddleware.auth_token [None req-8a73fceb-1cbe-4652-90d1-e1f44b2a74dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:27:19.879977 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555618e359c0 pid: 120622 (default app) Sep 12 23:27:56.236304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:56.238807 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:56.239531 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:56.241416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:56.279488 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:56.280344 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:56.281316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:56.282055 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:27:57.848719 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-683b1ab1-47fa-4bd9-a16d-0232ce8fb3d6 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Action: 'create', calling method: .version_select at 0x7fa4b47b5430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1770322576"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:27:57.946447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-72029bfe-78da-4448-8c75-491bd605dfd0 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Action: 'create', calling method: .version_select at 0x7fa4b47b5430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1514977834", "metadata": {"Type": "work"}}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:27:59.396388 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-683b1ab1-47fa-4bd9-a16d-0232ce8fb3d6 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.121574 Sep 12 23:27:59.397713 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Sep 12 23:27:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3125 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 12 23:27:59.419418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f6b726fa-b476-474d-9ddf-c5f394402473 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b4689310>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:27:59.498714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-72029bfe-78da-4448-8c75-491bd605dfd0 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.277380 Sep 12 23:27:59.500071 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 1/2] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Sep 12 23:27:56 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3281 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 12 23:27:59.519058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6574da92-5cd5-4ad1-9acc-b53e94a5cafd tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Calling method '.version_select at 0x7fa4b4689310>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:27:59.591710 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f6b726fa-b476-474d-9ddf-c5f394402473 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa" status: 200 len: 345 microversion: 2.1 time: 0.179013 Sep 12 23:27:59.600958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:27:59 2022] GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa => generated 345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:27:59.701189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6574da92-5cd5-4ad1-9acc-b53e94a5cafd tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93" status: 200 len: 353 microversion: 2.1 time: 0.189292 Sep 12 23:27:59.702929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:27:59 2022] GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93 => generated 353 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:00.613241 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-82766c38-5b46-46d0-8ce4-d06497914d39 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b46899d0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:00.722037 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f6ffa8aa-56b5-40e7-bf75-6ceaf02f7c48 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Calling method '.version_select at 0x7fa4b46899d0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:00.866723 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f6ffa8aa-56b5-40e7-bf75-6ceaf02f7c48 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93" status: 200 len: 354 microversion: 2.1 time: 0.153037 Sep 12 23:28:00.867320 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:00 2022] GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93 => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:00.881298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a071c655-a668-4f31-bd01-ac7956a087b6 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Calling method '.version_select at 0x7fa4b461f0d0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:00.946987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a071c655-a668-4f31-bd01-ac7956a087b6 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93" status: 200 len: 354 microversion: 2.1 time: 0.070378 Sep 12 23:28:00.947544 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 4/6] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:00 2022] GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:28:00.964376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-82766c38-5b46-46d0-8ce4-d06497914d39 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa" status: 200 len: 346 microversion: 2.1 time: 0.354561 Sep 12 23:28:00.969424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ecdaae1a-293d-496a-8f2d-8a8ccd281e0b tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Calling method '.version_select at 0x7fa4b4689d30>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:00.972947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:00 2022] GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa => generated 346 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:00.977675 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7b838588-76a4-46d7-9d76-bd3590887121 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Action: 'create', calling method: .version_select at 0x7fa4b4623040>, body: {"snapshot": {"volume_id": "34280534-20f3-4008-a483-2048e7d0ebfa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1103226248"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:01.172334 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ecdaae1a-293d-496a-8f2d-8a8ccd281e0b tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93" status: 202 len: 0 microversion: 2.1 time: 0.206413 Sep 12 23:28:01.173392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:28:00 2022] DELETE /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:28:01.181869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4dc3350e-0114-4f13-b74b-3fc8413f2ac9 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Calling method '.version_select at 0x7fa4b4689670>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:01.300370 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4dc3350e-0114-4f13-b74b-3fc8413f2ac9 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93" status: 200 len: 353 microversion: 2.1 time: 0.118259 Sep 12 23:28:01.301439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 6/9] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:01 2022] GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:01.511845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7b838588-76a4-46d7-9d76-bd3590887121 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.537035 Sep 12 23:28:01.513673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 4/10] 10.222.0.27 () {60 vars in 1162 bytes} [Mon Sep 12 23:28:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:01.523888 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f0d52757-e3ff-4260-9ffd-5b0adfff6109 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b461f1f0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:01.644264 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f0d52757-e3ff-4260-9ffd-5b0adfff6109 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 200 len: 287 microversion: 2.1 time: 0.124523 Sep 12 23:28:01.645153 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 7/11] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Sep 12 23:28:01 2022] GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:01.659455 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-558c4cbc-b740-47f0-9f17-799b777380e5 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b4623af0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:01.773794 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-558c4cbc-b740-47f0-9f17-799b777380e5 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121212 Sep 12 23:28:01.775209 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 5/12] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Sep 12 23:28:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:01.786590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-99887972-58e9-4977-bedd-a5fee3882797 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b46894c0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:01.837923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-99887972-58e9-4977-bedd-a5fee3882797 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 200 len: 287 microversion: 2.1 time: 0.055227 Sep 12 23:28:01.838853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Sep 12 23:28:01 2022] GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:02.320778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e94b3ca7-f91c-4ec0-a50e-407d096864b1 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Calling method '.version_select at 0x7fa4b46899d0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:02.385654 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-e94b3ca7-f91c-4ec0-a50e-407d096864b1 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] HTTP exception thrown: Volume 31092370-6b05-49a4-a789-dbabd3bc7f93 could not be found. Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e94b3ca7-f91c-4ec0-a50e-407d096864b1 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Request method failure captured: Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93 HTTP/1.1 Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8B8S4neT8W621ZI4KxKpU0bJgMqaJzBvcamzIc0nvMFgyIpKIWOaMo4TrWE6p6C83JjQUd58pGbpMU1fFbOckmctSPwoxDjtwkP5LI_niuCLG4Lvsda2ZsSbZhMrmBkF63wPkhuUGP04psCWOymiTnlo6VMQwaCePAvqWF0NjxPokY Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 1b1b14efb0dd42fcad321d9b5c8dafed Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesGetTestJSON-1233117238 Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:28:02.394601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1b1b14efb0dd42fcad321d9b5c8dafed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1b1b14efb0dd42fcad321d9b5c8dafed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b1b14efb0dd42fcad321d9b5c8dafed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1b1b14efb0dd42fcad321d9b5c8dafed"}]}] Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesGetTestJSON-1233117238 Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 1b1b14efb0dd42fcad321d9b5c8dafed Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesGetTestJSON-1233117238 Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesGetTestJSON-1233117238-project Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 582ac771652d49f7a79facf89374e5bf Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesGetTestJSON-1233117238-project Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Volume 31092370-6b05-49a4-a789-dbabd3bc7f93 could not be found. Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '31092370-6b05-49a4-a789-dbabd3bc7f93'} Sep 12 23:28:02.395798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31092370-6b05-49a4-a789-dbabd3bc7f93 could not be found. (HTTP 404) (Request-ID: req-97aaa30a-8285-4653-af9d-378643b47c16) Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:02.396419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:02.397242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31092370-6b05-49a4-a789-dbabd3bc7f93 could not be found. Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 23:28:02.398128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31092370-6b05-49a4-a789-dbabd3bc7f93 could not be found. Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31092370-6b05-49a4-a789-dbabd3bc7f93 could not be found. Sep 12 23:28:02.398954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:02.401902 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e94b3ca7-f91c-4ec0-a50e-407d096864b1 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] Returning 404 to user: Volume 31092370-6b05-49a4-a789-dbabd3bc7f93 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:28:02.403621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e94b3ca7-f91c-4ec0-a50e-407d096864b1 tempest-VolumesGetTestJSON-1233117238 tempest-VolumesGetTestJSON-1233117238-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93" status: 404 len: 109 microversion: 2.1 time: 0.091819 Sep 12 23:28:02.416729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 6/14] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:02 2022] GET /compute/v2.1/os-volumes/31092370-6b05-49a4-a789-dbabd3bc7f93 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:28:02.852879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a33cddfb-1ebc-4ad7-835a-556a67a14f3e tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b4689b80>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:02.929541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a33cddfb-1ebc-4ad7-835a-556a67a14f3e tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 200 len: 287 microversion: 2.1 time: 0.081199 Sep 12 23:28:02.930522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 9/15] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Sep 12 23:28:02 2022] GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:03.946530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d9992a65-cab7-41fa-b902-40198a4124f6 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b4689f70>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:04.034013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d9992a65-cab7-41fa-b902-40198a4124f6 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 200 len: 287 microversion: 2.1 time: 0.094613 Sep 12 23:28:04.034578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 7/16] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Sep 12 23:28:03 2022] GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:05.049277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ba619aad-d37c-4a0b-aff1-333cb24c4e91 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b461f670>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:05.133447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ba619aad-d37c-4a0b-aff1-333cb24c4e91 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 200 len: 288 microversion: 2.1 time: 0.087835 Sep 12 23:28:05.134475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 10/17] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Sep 12 23:28:05 2022] GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:05.157201 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d4ef7cbf-6c13-4ec5-b942-05452c7e7a5a tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b460b1f0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:05.284250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d4ef7cbf-6c13-4ec5-b942-05452c7e7a5a tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 202 len: 0 microversion: 2.1 time: 0.141532 Sep 12 23:28:05.287306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 8/18] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Sep 12 23:28:05 2022] DELETE /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:28:05.299678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-985700e1-b801-4c00-ada1-6f619a89e24d tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b4689e50>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:05.632790 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-985700e1-b801-4c00-ada1-6f619a89e24d tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 200 len: 287 microversion: 2.1 time: 0.339046 Sep 12 23:28:05.633408 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 11/19] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Sep 12 23:28:05 2022] GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 287 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:06.659943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-af81f535-07c1-405b-b486-1eb51515417a tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b46893a0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:06.709568 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-af81f535-07c1-405b-b486-1eb51515417a tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] HTTP exception thrown: Snapshot 16f4ac33-2b4e-4b15-b428-354f86d1d9b9 could not be found. Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-af81f535-07c1-405b-b486-1eb51515417a tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Request method failure captured: Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 HTTP/1.1 Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8B8AkZWCdOuk0D4tN-gaBPzIDK8FpUJbnSHFNZfPzQqj1qMrT9_sUwyg3c-PIgNXM9hctV0YoggYCipnpEdoL1ri7_b0KiOFYqirDWHbzTlII9c-x8AKTvDGDPdODMj3kSGF_4-EtcUpBzM1hbkgnsmIf4jRDAl2Z3V-iY__5IeFDI Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:28:06.713300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2bcb31c2c0646ff80d50c51c842db89", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}] Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 32e5b36aa97747d798b79509f3f66dd5 Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Snapshot 16f4ac33-2b4e-4b15-b428-354f86d1d9b9 could not be found. Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '16f4ac33-2b4e-4b15-b428-354f86d1d9b9'} Sep 12 23:28:06.714435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 16f4ac33-2b4e-4b15-b428-354f86d1d9b9 could not be found. (HTTP 404) (Request-ID: req-1a0eb1ef-eb8c-44cf-afb5-93fd92fdcb23) Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:06.715149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:06.716114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 16f4ac33-2b4e-4b15-b428-354f86d1d9b9 could not be found. Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 12 23:28:06.717020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 16f4ac33-2b4e-4b15-b428-354f86d1d9b9 could not be found. Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 16f4ac33-2b4e-4b15-b428-354f86d1d9b9 could not be found. Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-af81f535-07c1-405b-b486-1eb51515417a tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Returning 404 to user: Snapshot 16f4ac33-2b4e-4b15-b428-354f86d1d9b9 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:28:06.720428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-af81f535-07c1-405b-b486-1eb51515417a tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9" status: 404 len: 111 microversion: 2.1 time: 0.072706 Sep 12 23:28:06.722066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 9/20] 10.222.0.27 () {58 vars in 1251 bytes} [Mon Sep 12 23:28:06 2022] GET /compute/v2.1/os-snapshots/16f4ac33-2b4e-4b15-b428-354f86d1d9b9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:28:06.726250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a7f976ec-92fa-4307-8d27-2c6cd39c0a45 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b4689790>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:06.888416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a7f976ec-92fa-4307-8d27-2c6cd39c0a45 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa" status: 202 len: 0 microversion: 2.1 time: 0.166915 Sep 12 23:28:06.890652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 12/21] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:28:06 2022] DELETE /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:28:06.901108 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d81b9044-9c26-4822-b436-6723b4b648f7 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b460b9d0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:07.022982 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d81b9044-9c26-4822-b436-6723b4b648f7 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa" status: 200 len: 345 microversion: 2.1 time: 0.127593 Sep 12 23:28:07.025393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 10/22] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:06 2022] GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:07.762599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d17c4bfb-b5a5-45dd-8d1f-24a59b0867f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'create', calling method: .version_select at 0x7fa4b461f430>, body: {"keypair": {"name": "tempest-keypair-1819024859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSYAlsScsHempCBlIySgtHf4deeXQf8P/5PkCJLx0vwqswNH7EYkgRqrURRRGZmbqFeahX8bshVQGFxNSGftT5JumbziepNdQQCBUZs3+fZg7Nwo/rfTPy+m0YlR4luGA=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:07.841521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-d17c4bfb-b5a5-45dd-8d1f-24a59b0867f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:07.855240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-d17c4bfb-b5a5-45dd-8d1f-24a59b0867f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for user 2749a61b3dd04d89a5c2e4235aa96934 and project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:07.970392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d17c4bfb-b5a5-45dd-8d1f-24a59b0867f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.442854 Sep 12 23:28:07.971349 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 13/23] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Sep 12 23:28:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 446 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 12 23:28:08.058907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-311de1b3-8b57-4111-a089-17279c910bcf tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b4689e50>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:08.115838 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-311de1b3-8b57-4111-a089-17279c910bcf tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] HTTP exception thrown: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-311de1b3-8b57-4111-a089-17279c910bcf tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Request method failure captured: Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa HTTP/1.1 Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8B8AkZWCdOuk0D4tN-gaBPzIDK8FpUJbnSHFNZfPzQqj1qMrT9_sUwyg3c-PIgNXM9hctV0YoggYCipnpEdoL1ri7_b0KiOFYqirDWHbzTlII9c-x8AKTvDGDPdODMj3kSGF_4-EtcUpBzM1hbkgnsmIf4jRDAl2Z3V-iY__5IeFDI Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:28:08.118192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2bcb31c2c0646ff80d50c51c842db89", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}] Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 32e5b36aa97747d798b79509f3f66dd5 Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '34280534-20f3-4008-a483-2048e7d0ebfa'} Sep 12 23:28:08.120786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. (HTTP 404) (Request-ID: req-c45e8420-7cc3-42fc-8c7e-232259ac6b44) Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.121699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:08.122715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 23:28:08.123830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-311de1b3-8b57-4111-a089-17279c910bcf tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Returning 404 to user: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:28:08.124739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-311de1b3-8b57-4111-a089-17279c910bcf tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa" status: 404 len: 109 microversion: 2.1 time: 0.072908 Sep 12 23:28:08.131267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:08 2022] GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:28:08.136244 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc3803a3-5435-425f-908e-689f36248ca5 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b46098b0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:08.194684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-fc3803a3-5435-425f-908e-689f36248ca5 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] HTTP exception thrown: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc3803a3-5435-425f-908e-689f36248ca5 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Request method failure captured: Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa HTTP/1.1 Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8B8AkZWCdOuk0D4tN-gaBPzIDK8FpUJbnSHFNZfPzQqj1qMrT9_sUwyg3c-PIgNXM9hctV0YoggYCipnpEdoL1ri7_b0KiOFYqirDWHbzTlII9c-x8AKTvDGDPdODMj3kSGF_4-EtcUpBzM1hbkgnsmIf4jRDAl2Z3V-iY__5IeFDI Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:28:08.198672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2bcb31c2c0646ff80d50c51c842db89", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}] Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 32e5b36aa97747d798b79509f3f66dd5 Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '34280534-20f3-4008-a483-2048e7d0ebfa'} Sep 12 23:28:08.200097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. (HTTP 404) (Request-ID: req-41d26749-2f6a-4f56-955d-0d7f5afd426b) Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.200855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:28:08.202018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 23:28:08.203333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc3803a3-5435-425f-908e-689f36248ca5 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Returning 404 to user: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fc3803a3-5435-425f-908e-689f36248ca5 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa" status: 404 len: 109 microversion: 2.1 time: 0.068410 Sep 12 23:28:08.205610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:28:08 2022] DELETE /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:28:08.211310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9df24103-7a97-43e4-b2ee-bc16de85c534 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Calling method '.version_select at 0x7fa4b460b8b0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:08.274175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-9df24103-7a97-43e4-b2ee-bc16de85c534 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] HTTP exception thrown: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9df24103-7a97-43e4-b2ee-bc16de85c534 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Request method failure captured: Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa HTTP/1.1 Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8B8AkZWCdOuk0D4tN-gaBPzIDK8FpUJbnSHFNZfPzQqj1qMrT9_sUwyg3c-PIgNXM9hctV0YoggYCipnpEdoL1ri7_b0KiOFYqirDWHbzTlII9c-x8AKTvDGDPdODMj3kSGF_4-EtcUpBzM1hbkgnsmIf4jRDAl2Z3V-iY__5IeFDI Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:28:08.276238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c2bcb31c2c0646ff80d50c51c842db89", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c2bcb31c2c0646ff80d50c51c842db89"}]}] Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: c2bcb31c2c0646ff80d50c51c842db89 Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1045522980 Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 32e5b36aa97747d798b79509f3f66dd5 Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1045522980-project Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '34280534-20f3-4008-a483-2048e7d0ebfa'} Sep 12 23:28:08.277292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. (HTTP 404) (Request-ID: req-687fb733-3dcd-4055-b22d-e86e257b272a) Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.278041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:28:08.278971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 23:28:08.280040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9df24103-7a97-43e4-b2ee-bc16de85c534 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] Returning 404 to user: Volume 34280534-20f3-4008-a483-2048e7d0ebfa could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9df24103-7a97-43e4-b2ee-bc16de85c534 tempest-VolumesSnapshotsTestJSON-1045522980 tempest-VolumesSnapshotsTestJSON-1045522980-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa" status: 404 len: 109 microversion: 2.1 time: 0.072257 Sep 12 23:28:08.281389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 12/26] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:28:08 2022] GET /compute/v2.1/os-volumes/34280534-20f3-4008-a483-2048e7d0ebfa => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:28:11.387216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f908b223-ce33-45fa-8068-23a789913bbf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'create', calling method: .version_select at 0x7fa4b4fe28b0>, body: {"keypair": {"name": "tempest-keypair-1423738299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7xggt9r0lraqBvXwFtAq9bFeXPI7amTAzIpaVD4yoE2hQCmtvYeTFXPCBzqcvusAFmLsiiziFqDG5YD+Tn6sV4nTZETZ1uD1rrWUEz2g8I/3Sy8bMasgkpr/Su320/GQ=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:11.428890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-f908b223-ce33-45fa-8068-23a789913bbf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:11.441228 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-f908b223-ce33-45fa-8068-23a789913bbf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for user 7f56dde21c754cfe8253ec5c1b7b90d7 and project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:11.491476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f908b223-ce33-45fa-8068-23a789913bbf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.423949 Sep 12 23:28:11.492185 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 15/27] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:28:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:14.451912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-354930426", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11be7f0c-3ec4-4c81-8e43-cbebcc992505"}], "security_groups": [{"name": "tempest-securitygroup--1446125107"}], "key_name": "tempest-keypair-1819024859", "user_data": "}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:14.983639 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] validate_networks() for [('11be7f0c-3ec4-4c81-8e43-cbebcc992505', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:28:17.388322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2000293548", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:17.598206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] validate_networks() for [('06716bca-7ab1-4703-8226-2e627ce51e59', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:28:18.266945 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:28:18.268669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:28:18.269168 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:28:18.269586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:28:18.270003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:28:18.309506 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:18.310841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:18.311284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:18.313439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:18.313905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:18.314413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:18.401855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:18.416094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for user 2749a61b3dd04d89a5c2e4235aa96934 and project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:18.462785 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:28:18.475859 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:28:18.826985 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a569a187-7d62-4b56-b581-e1375c7fe2b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.379884 Sep 12 23:28:18.842288 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 13/28] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Sep 12 23:28:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 4396 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 23:28:18.860431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-73acbd0a-e2e5-4369-baa1-ad17363d966a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:18.862779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-73acbd0a-e2e5-4369-baa1-ad17363d966a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:19.336346 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-73acbd0a-e2e5-4369-baa1-ad17363d966a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:19.370367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-73acbd0a-e2e5-4369-baa1-ad17363d966a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:19.380083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-73acbd0a-e2e5-4369-baa1-ad17363d966a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:19.381747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-73acbd0a-e2e5-4369-baa1-ad17363d966a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1281 microversion: 2.20 time: 0.528525 Sep 12 23:28:19.396296 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 14/29] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:18 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1281 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:20.641017 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1008958038", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "networks": [{"uuid": "ae15af67-8ae4-4684-be7f-236803ff9254"}]}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:20.781944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] validate_networks() for [('ae15af67-8ae4-4684-be7f-236803ff9254', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:28:21.454603 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:21.461628 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:28:21.462316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:28:21.462995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:28:21.463627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:28:21.464246 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:28:21.484354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:21.487436 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:21.488150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:21.489282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:21.490004 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:21.490652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:21.520525 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for project adc049ff85c14935a9f68be76cd61c05. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:21.524935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for user 0248519bf5b54ce3ba3b40f2c9a4c628 and project adc049ff85c14935a9f68be76cd61c05. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:21.541064 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:28:21.544259 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:28:21.653018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b863d5e2-42af-4ae8-836a-deff0bf73e96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.574582 Sep 12 23:28:21.654516 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 16/30] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:28:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:28:21.662858 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-176475144", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87d38067-03b8-4be7-846c-3dce062309f6"}], "security_groups": [{"name": "tempest-securitygroup--1098524119"}], "key_name": "tempest-keypair-1423738299", "user_data": "}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:21.707402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:28:21.707971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:28:21.708316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:28:21.708920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:28:21.709482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:28:21.780029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:21.781360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:21.782075 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:21.783924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:21.784674 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:21.785387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:21.834380 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Getting quotas for project 811d8512813f49d79facec817fc5d03e. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:21.845844 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Getting quotas for user 98da6780db2d43d5be8e971dd2d86119 and project 811d8512813f49d79facec817fc5d03e. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:21.880071 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:28:21.885606 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:28:21.976256 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] validate_networks() for [('87d38067-03b8-4be7-846c-3dce062309f6', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:28:22.032812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3191935d-2bde-4dc5-9cab-66fb5d50963b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.114051 Sep 12 23:28:22.042940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 15/31] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:28:22.052429 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:22.059945 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:22.073782 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:22.076167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:22.077395 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:22.078284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:22.080736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:22.083472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:22.546850 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:22.576938 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:22.595966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:22.609192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1a922bb4-8ad4-4fa5-9281-65be0ea1a1c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1285 microversion: 2.20 time: 0.560145 Sep 12 23:28:22.610022 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 16/32] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:22 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1285 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:22.654106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-668107c9-1239-4b94-9d27-25c50b3c038d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:22.655375 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-668107c9-1239-4b94-9d27-25c50b3c038d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:22.807370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-668107c9-1239-4b94-9d27-25c50b3c038d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:22.814832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-668107c9-1239-4b94-9d27-25c50b3c038d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1222 microversion: 2.1 time: 0.187271 Sep 12 23:28:22.824804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 17/33] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:22 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:22.834864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7102b9a1-a543-4c8a-8301-74bab2bb5e54 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:22.835734 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7102b9a1-a543-4c8a-8301-74bab2bb5e54 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:22.971440 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7102b9a1-a543-4c8a-8301-74bab2bb5e54 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:22.980369 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7102b9a1-a543-4c8a-8301-74bab2bb5e54 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1215 microversion: 2.1 time: 0.154245 Sep 12 23:28:22.980957 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 18/34] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:22 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:23.022480 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:28:23.024654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:28:23.026550 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:28:23.027090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:28:23.028336 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:28:23.085397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:23.088705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:23.089168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:23.092478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:23.092960 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:23.093397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:23.146808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:23.158417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for user 7f56dde21c754cfe8253ec5c1b7b90d7 and project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:23.197631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:28:23.204593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:28:23.235542 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1853204827", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:23.307541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3c7b2c0f-29df-4ad3-9f4a-6dd85f5bb394 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.651444 Sep 12 23:28:23.308364 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 17/35] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:28:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:28:23.322426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b0b1f7d9-7a9a-4b3e-bc14-a3a0f69ff5c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:23.323455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b0b1f7d9-7a9a-4b3e-bc14-a3a0f69ff5c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:23.334305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] validate_networks() for [('06716bca-7ab1-4703-8226-2e627ce51e59', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:28:23.569944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b0b1f7d9-7a9a-4b3e-bc14-a3a0f69ff5c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:23.607104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b0b1f7d9-7a9a-4b3e-bc14-a3a0f69ff5c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1237 microversion: 2.1 time: 0.288018 Sep 12 23:28:23.608076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 18/36] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:23 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1237 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:23.644322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:23.645051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:23.692512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:23.697018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:23.697814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:23.698754 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:23.699986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:23.701513 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:23.931351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:23.954413 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:23.960640 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:23.961804 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f674d52d-c42f-4a4f-96b9-3102cc8d954c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1277 microversion: 2.20 time: 0.324704 Sep 12 23:28:23.964510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 19/37] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:23 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1277 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:28:24.010374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:24.011072 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:24.021934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:24.022529 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:24.023468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:24.027186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:24.027734 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:24.029432 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:24.215549 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:24.226576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1f0c440a-0884-4d10-9f1a-73b9ad25313b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1219 microversion: 2.1 time: 0.220033 Sep 12 23:28:24.228740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 20/38] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:24 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1219 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:24.393621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:28:24.394098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:28:24.394661 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:28:24.395136 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:28:24.395650 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:28:24.413136 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:24.414715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:24.416253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:24.418915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:24.421531 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:24.422173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:24.464077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for project adc049ff85c14935a9f68be76cd61c05. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:24.475560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for user 0248519bf5b54ce3ba3b40f2c9a4c628 and project adc049ff85c14935a9f68be76cd61c05. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:24.496982 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:28:24.499459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:28:24.592648 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8e87a923-119e-4886-a6f5-467929c106a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.362178 Sep 12 23:28:24.593434 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:28:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:28:24.605406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c79beab7-93cb-422f-b9e8-5c0bcb072982 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:24.606419 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c79beab7-93cb-422f-b9e8-5c0bcb072982 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:24.635503 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:24.636684 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:24.651084 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:24.652097 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:24.653478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:24.654595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:24.655379 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:24.657045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:24.714288 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c79beab7-93cb-422f-b9e8-5c0bcb072982 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:24.723522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c79beab7-93cb-422f-b9e8-5c0bcb072982 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1222 microversion: 2.1 time: 0.121937 Sep 12 23:28:24.724899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:24 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:24.753946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:24.766466 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b5f06629-fc85-4e1a-b535-5bffe4fb6c35 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1241 microversion: 2.1 time: 0.136805 Sep 12 23:28:24.784387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 20/41] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:24 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:24.991194 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:24.991842 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:24.999760 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.000295 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.001382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.002301 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.010033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.010499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.124696 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:25.146930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:25.148859 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:25.150495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b5a7a7c0-cf51-48e6-a9b2-5faee5d1ac92 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1277 microversion: 2.20 time: 0.163068 Sep 12 23:28:25.151194 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:24 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:25.250410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:25.251053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:25.263609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.270500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.271083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.271997 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.278393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.278853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.430454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:25.447238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2a10a69e-77c0-4bd5-a643-182342b7fe46 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1211 microversion: 2.1 time: 0.200902 Sep 12 23:28:25.450384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:25 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1211 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:25.750180 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:25.750905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:25.757747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.758237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.758675 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.759366 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.759999 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.760424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.801255 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:25.803509 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:25.814978 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.815472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.815936 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.816630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:25.817070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:25.817488 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:25.848315 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:25.856394 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-47ddecc4-8855-431b-96ae-1dd05f38c2cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.109953 Sep 12 23:28:25.856957 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 23/44] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:25 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:25.925304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:25.933498 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-84d12369-7c0e-481b-be7d-b633da39f0cb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.142810 Sep 12 23:28:25.934112 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 22/45] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:25 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:26.180893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:26.182416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:26.201558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.204338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.206717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.211039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.212161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.212875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.374530 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:26.387547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:26.390119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:26.407629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5a1fd733-46a7-4d7d-8278-5cb6555fb708 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1341 microversion: 2.20 time: 0.231095 Sep 12 23:28:26.408446 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:26 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1341 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:26.477189 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:26.478287 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:26.490382 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.490887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.491327 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.498765 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.500584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.501041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.679840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:26.708593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4ef50f72-f912-4e76-995e-74b8a259b255 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1267 microversion: 2.1 time: 0.235556 Sep 12 23:28:26.710407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 23/47] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:26 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:26.880559 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:26.881188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:26.890852 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.892463 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.893113 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.894026 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.895875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.896532 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.959143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:26.960421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:26.968149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:26.968348 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.970757 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.974099 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.975528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:26.976227 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:26.978228 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:26.985593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ade55a22-fa7b-46f5-8c9a-366dd2c00972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.101405 Sep 12 23:28:26.986934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:26 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:27.073436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:27.081157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bc48e87a-ac38-4fa5-bb35-c91d17f00c99 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.126871 Sep 12 23:28:27.081919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 24/49] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:26 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:27.440158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:27.441151 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:27.448105 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:27.448954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:27.449574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:27.450520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:27.450954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:27.451378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:27.518421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:27.526596 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:27.528065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:27.529174 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a493b4ee-71c7-471b-8f26-b6b75e233d35 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1339 microversion: 2.20 time: 0.093522 Sep 12 23:28:27.529708 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:27 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:27.734090 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:27.734542 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:27.740970 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:27.741547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:27.742058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:27.742958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:27.743635 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:27.744156 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:27.818197 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:27.825967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1df2b237-9132-4efd-a308-7c6324f8efb9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1267 microversion: 2.1 time: 0.096149 Sep 12 23:28:27.826533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 25/51] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:27 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:28.009653 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:28.010330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:28.016544 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.017563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.018003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.018821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.019665 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.020063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.082890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:28.091241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d6a979ea-f57e-4410-bc84-85b27264a73d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.086474 Sep 12 23:28:28.091860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 27/52] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:28 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:28.106563 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:28.107603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:28.116019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.116541 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.116971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.117841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.118406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.118830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.183797 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:28.193948 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-25910a33-9405-443b-ae72-53ee939cdca9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.091191 Sep 12 23:28:28.194698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 26/53] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:28 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:28.554991 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:28.555624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:28.561558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.562044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.562479 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.563169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.564169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.564745 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.625704 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:28.634488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:28.636325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:28.637076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-25bf790b-48ab-40fc-92a4-e2d9303d3838 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1339 microversion: 2.20 time: 0.086042 Sep 12 23:28:28.638015 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 28/54] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:28 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:28.849607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:28.850314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:28.857855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.858374 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.858790 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.859471 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:28.860284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:28.861290 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:28.950828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:28.959001 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7dd7c0a2-9136-4988-b3e5-2b15db554aca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1267 microversion: 2.1 time: 0.113198 Sep 12 23:28:28.959579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 27/55] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:28 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:29.115060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:29.115710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:29.121522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.122216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:29.122666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:29.123356 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.123844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:29.124298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:29.196094 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:29.205282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-07a4e642-82fc-4cc9-9513-f4dcf56e8d24 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.094795 Sep 12 23:28:29.205970 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 29/56] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:29 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:29.219217 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:29.220132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:29.226561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.227143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:29.227731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:29.228508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.229100 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:29.229635 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:29.300731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:29.315480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-638d01fa-f4dd-4af3-ab0f-5f9213938a53 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.100741 Sep 12 23:28:29.327766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 28/57] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:29 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:29.663984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:29.664778 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:29.670863 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.671488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:29.672066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:29.673014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.673537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:29.674028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:29.877915 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:29.889946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:29.892407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:29.894391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ff7ce05a-9565-44bf-b342-6a22366d10a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.234243 Sep 12 23:28:29.907710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 30/58] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:29 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:29.984806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:29.986736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:29.995743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.995743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:29.995743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:29.995743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:29.996344 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:30.009774 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:30.159669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:30.170607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-461083ed-14cf-409e-8381-63effe7128f4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.190672 Sep 12 23:28:30.187284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:29 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:30.230213 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:30.231255 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:30.240786 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:30.241657 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:30.243279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:30.244719 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:30.246139 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:30.247692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:30.341243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:30.342791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:30.372890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:30.379909 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:30.380705 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:30.381337 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:30.382587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:30.383271 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:30.383931 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:30.385801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9815cd04-c85b-4757-9de3-536c85b71a8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.159548 Sep 12 23:28:30.404618 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 31/60] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:30 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:30.506476 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:30.515769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-65163fef-fc09-46aa-a244-de5a51da6ff4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.178446 Sep 12 23:28:30.531387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 30/61] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:30 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:30.925452 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:30.926067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:30.932944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:30.933392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:30.933847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:30.934583 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:30.935251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:30.935933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:31.082007 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:31.090970 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:31.092431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:31.093535 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9723c0e0-699a-41d0-8d63-8bc6accbc0f7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.172091 Sep 12 23:28:31.094083 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:30 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:31.195129 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:31.195763 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:31.201879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:31.202374 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:31.202815 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:31.203512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:31.204034 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:31.204522 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:31.269728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:31.278389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-94f5e124-4ef6-415d-9d06-f807b28d6bca tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.087042 Sep 12 23:28:31.278907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:31 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:31.411397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:31.412032 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:31.418070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:31.418554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:31.418986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:31.419698 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:31.420152 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:31.420573 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:31.483224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:31.499201 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-55866035-d42a-48ed-8ed2-f7f8d2f4ec3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.091716 Sep 12 23:28:31.499851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 33/64] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:31 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:31.545506 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:31.546114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:31.552439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:31.552926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:31.553376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:31.554049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:31.554497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:31.554916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:31.645591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:31.653615 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4d442caf-8f0b-4ebf-b99b-c6526b502d49 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.113675 Sep 12 23:28:31.654470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 32/65] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:31 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:32.122742 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:32.123537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:32.130388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.130869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.131299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.132014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.132457 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.132871 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.275052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:32.284026 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:32.285807 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:32.287179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a36ed3f9-d496-47cf-8e74-5d339ceff852 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.168420 Sep 12 23:28:32.288022 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:32 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:32.302359 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:32.302944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:32.309146 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.309622 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.310045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.310729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.311171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.311614 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.386436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:32.394444 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4cc3dcd2-e0be-4871-9e2c-b940106a2d42 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.096293 Sep 12 23:28:32.395022 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 33/67] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:32 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:32.525799 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:32.526597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:32.534546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.535058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.535519 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.536248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.536703 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.537131 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.602972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:32.606368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:32.611308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9d5b0bbb-00b4-44f9-91fc-788ea5cd6f80 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.089442 Sep 12 23:28:32.612121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 35/68] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:32 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:32.677515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:32.678082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:32.684087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.684602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.685036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.685729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:32.686180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:32.686604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:32.705157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:32.753784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:32.767799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cc5a32c7-44e9-4845-b44b-5fa6fc790621 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.095045 Sep 12 23:28:32.769463 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 34/69] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:32 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:33.312646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:33.314552 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:33.320002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:33.320930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:33.323230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.323916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.324430 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.325195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.325663 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.326081 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.417072 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:33.417678 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:33.424170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.424661 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.425091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.425773 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.426219 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.426642 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.460811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:33.468922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:33.470884 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:33.472013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85cc04fd-2928-43a0-b872-80bea1a63d47 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.163575 Sep 12 23:28:33.472563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:33 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:33.486623 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:33.494513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b4721788-e7e0-4b0e-95e5-eaf983c7ded1 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.081431 Sep 12 23:28:33.495076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 35/71] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:33 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:33.638168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:33.639227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:33.645430 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.645908 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.646339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.647011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.647454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.647893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.728985 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:33.736629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-376f2100-d5a0-4c42-b15b-cb5354da30a3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.102946 Sep 12 23:28:33.747881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 37/72] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:33 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:33.794706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:33.795320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:33.801314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.801792 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.802219 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.802898 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:33.803343 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:33.803801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:33.873886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:33.882627 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e09ae300-6398-494c-ad0f-9c597d9e959e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.092221 Sep 12 23:28:33.883594 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 36/73] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:33 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:34.498318 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:34.499031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:34.505875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.506363 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.506799 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:34.507488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.507977 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.508400 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:34.517337 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:34.517977 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:34.520120 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:34.520771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=24 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:34.522700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:34.527196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.527729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.528159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:34.529010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.529441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.529862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:34.604546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:34.616104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-61073e19-0933-4db3-bd5e-16e86862edab tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.102530 Sep 12 23:28:34.616950 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 37/74] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:34 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:34.671414 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:34.681050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:34.682471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:34.683583 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c03f39d8-ed74-4ae4-b359-059aedacb2ef tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.189210 Sep 12 23:28:34.684137 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 38/75] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:34 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:34.760513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:34.761206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:34.768609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.769187 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.769685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:34.770446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.770964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.771681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:34.834846 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:34.842482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-58c3366f-78b6-4d5f-9ee1-7b0636cffc01 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.086551 Sep 12 23:28:34.843230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 38/76] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:34 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:34.910282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:34.911102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:34.919276 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=16 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:34.924062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.925011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.925528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:34.926119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:34.926567 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:34.926982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:35.017052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:35.025524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a8a8ec26-eefc-4f66-affd-ffba3e716c34 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.122396 Sep 12 23:28:35.025801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 39/77] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:34 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:35.644148 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:35.645134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:35.651943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:35.652537 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:35.652884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:35.653638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:35.654108 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:35.654515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:35.710274 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:35.710878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:35.716844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:35.717350 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:35.717780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:35.718457 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:35.718905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:35.719325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:35.723307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:35.730926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-255c2314-9203-4a04-a09f-d037edffc6cc tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.092036 Sep 12 23:28:35.731489 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 39/78] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:35 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:35.861367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:35.869560 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:35.870167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:35.870765 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:35.871005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:35.872142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5d7982cb-d46b-4adf-83a1-e18baa5fa028 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.165828 Sep 12 23:28:35.872708 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 40/79] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:35 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:28:35.876776 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:35.877242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:35.877672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:35.878345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:35.878785 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:35.879196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:35.945352 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:35.953570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-68176ed9-f742-4819-b372-8bb6b7beb9de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.087164 Sep 12 23:28:35.954691 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 40/80] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:35 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:36.049706 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:36.050583 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:36.056870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.057632 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.058249 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:36.059126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.059789 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.060643 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:36.129134 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:36.137406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-11b74f46-45a6-4651-ad10-61566b65ecc6 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.091664 Sep 12 23:28:36.137982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 41/81] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:36 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:36.754739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:36.755501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:36.761821 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.762320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.762757 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:36.763505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.763994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.764424 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:36.829369 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:36.837281 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3a014aff-65ed-4b0c-9a89-072dd1edde7a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.086756 Sep 12 23:28:36.837870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 41/82] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:36 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:36.897457 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:36.898112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:36.903945 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.904422 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.904852 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:36.905795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.906241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.906662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:36.976780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:36.977392 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:36.984470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.984972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.985410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:36.986111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:36.986565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:36.986999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:37.047306 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:37.061832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:37.071382 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-61801a42-a2cd-477f-bf1e-b3081f929ba1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.098277 Sep 12 23:28:37.073460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:37.075278 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:37.076594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-521c3c34-f293-46cd-a3f6-3716cd9cf321 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.183034 Sep 12 23:28:37.091943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 42/83] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:36 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:37.092039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 42/84] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:36 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:37.170015 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:37.170899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:37.177058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:37.177545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:37.177974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:37.178665 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:37.179117 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:37.179663 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:37.246929 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:37.255282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-67582620-172a-4f86-a4b2-58e48c9e9bf7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.090891 Sep 12 23:28:37.256133 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 43/85] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:37 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:37.862416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:37.863029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:37.869013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:37.869563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:37.870088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:37.870911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:37.871369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:37.871823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:37.938946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:37.946442 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e4851b4c-9581-4f7a-a72c-d997de5e2224 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1275 microversion: 2.1 time: 0.088422 Sep 12 23:28:37.947000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 43/86] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:37 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:38.096763 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:38.097391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:38.102490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:38.103095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:38.103341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.103853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.104279 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:38.104954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.105558 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.105972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:38.109277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.109819 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.111010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:38.111830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.112352 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.112779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:38.185502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:38.193696 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-34d943be-f607-4c43-bec4-5e2ea158c174 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.101344 Sep 12 23:28:38.194595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 44/87] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:38 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:38.248983 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:38.258185 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:38.260029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:38.261301 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c520e745-6111-4e98-8cf6-5d9e182098f2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.162692 Sep 12 23:28:38.262800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 44/88] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:38 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:38.281288 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:38.282144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:38.288704 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.289328 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.289861 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:38.290847 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.291398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.292132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:38.434921 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:38.444590 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a80fd76e-fd5e-44bf-ba12-35188561955e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1233 microversion: 2.1 time: 0.167613 Sep 12 23:28:38.449975 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 45/89] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:38 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1233 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:38.969006 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:38.970254 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:38.978712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.979434 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.980677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:38.982327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:38.983788 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:38.984553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:39.098563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:39.107812 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-20a781dc-e754-49ac-9d1f-1e32b9568a2d tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1273 microversion: 2.1 time: 0.142617 Sep 12 23:28:39.108948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 45/90] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:38 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:39.217556 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:39.218208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:39.226548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:39.227201 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:39.229354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:39.230407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:39.232014 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:39.233524 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:39.296787 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:39.298130 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:39.313703 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:39.317105 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:39.323933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:39.325170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:39.327600 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:39.328117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:39.391433 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:39.409130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3aed93d0-8d1f-4149-80e2-2b17e7d5b280 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1218 microversion: 2.1 time: 0.195451 Sep 12 23:28:39.417876 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 46/91] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:39 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:39.470881 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:39.471495 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:39.479547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:39.480158 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:39.480759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:39.481454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:39.481899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:39.482323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:39.607854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:39.617574 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-98b7d42e-778c-4006-b44e-1526f1b2e86d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1295 microversion: 2.1 time: 0.151153 Sep 12 23:28:39.642178 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 47/92] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:39 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1295 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:39.661869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:39.683008 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:39.685072 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:39.693282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6c815ab3-a5a5-4b20-9f70-9bf91a635668 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.400577 Sep 12 23:28:39.693984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 46/93] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:39 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:40.133320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:40.133934 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:40.161079 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.161880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.164103 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:40.166737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.169601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.171319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:40.434583 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:40.435253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:40.444974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.451318 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.453064 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:40.455362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.456505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.460085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:40.665840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:40.683776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c2dcb5cb-b2c3-4ee0-9e63-758487700378 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1274 microversion: 2.1 time: 0.253311 Sep 12 23:28:40.686240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 47/94] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:40 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:40.694230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:40.694848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:40.721602 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.725395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.730712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:40.731487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.732008 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.732436 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:40.889086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:40.913199 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9f16a5c6-4396-474c-8d4c-478abb7634b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1295 microversion: 2.1 time: 0.216349 Sep 12 23:28:40.927889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 48/95] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:40 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1295 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:40.941199 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:40.941875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:40.951344 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.951867 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.952298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:40.958496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:40.959292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:40.959986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:41.324133 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:41.340320 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:41.343444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:41.348102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-628a0670-9f9d-4688-aa20-449691753c97 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.418936 Sep 12 23:28:41.364088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 49/96] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:40 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:41.364791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:41.364791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cd64fd68-e922-4b23-9c47-bd43d0ab69aa tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 1.233257 Sep 12 23:28:41.375900 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 48/97] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:40 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:41.707590 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:41.708851 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:41.717707 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:41.720197 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:41.720820 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:41.723307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:41.725843 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:41.726543 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:41.945112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-110ee566-d809-4606-a3d7-bd749ae4fa8a req-289b8d9c-20cd-40ae-abc4-6b89729b5284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07d4dcb-1679-4627-b94b-adc34cfffbb3", "tag": "fbdc10fe-ce53-41fd-a771-18e381482273"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:41.994653 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-110ee566-d809-4606-a3d7-bd749ae4fa8a req-289b8d9c-20cd-40ae-abc4-6b89729b5284 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:41.998346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-110ee566-d809-4606-a3d7-bd749ae4fa8a req-289b8d9c-20cd-40ae-abc4-6b89729b5284 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:41.998994 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-110ee566-d809-4606-a3d7-bd749ae4fa8a req-289b8d9c-20cd-40ae-abc4-6b89729b5284 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.071673 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-110ee566-d809-4606-a3d7-bd749ae4fa8a req-289b8d9c-20cd-40ae-abc4-6b89729b5284 service nova] Creating event network-changed:fbdc10fe-ce53-41fd-a771-18e381482273 for instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 on hv-cinder-85200 Sep 12 23:28:42.077346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-110ee566-d809-4606-a3d7-bd749ae4fa8a req-289b8d9c-20cd-40ae-abc4-6b89729b5284 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120621) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 23:28:42.077884 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-110ee566-d809-4606-a3d7-bd749ae4fa8a req-289b8d9c-20cd-40ae-abc4-6b89729b5284 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120621) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 23:28:42.081651 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.082242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.083812 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.086624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.087284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.089853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.108578 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.compute.rpcapi [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 23:28:42.109658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120621) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 23:28:42.130816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d388cda5-dfb1-4cb0-898c-1738f75c4bb6 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702155 Sep 12 23:28:42.131979 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 50/98] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:42.138695 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:42.139493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:42.147342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.149175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.149175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.158478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.159089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.160142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.330153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:42.340132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2da62988-ba9a-40d2-9b40-0f25a7b36c14 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1280 microversion: 2.1 time: 0.636448 Sep 12 23:28:42.341703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:41 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1280 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:42.377896 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:42.378573 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:42.386271 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.387186 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.387842 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.388833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.389529 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.390166 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.472517 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:42.480601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-74a5b822-e36d-47a3-8747-c5a8d3d24d56 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.347034 Sep 12 23:28:42.481232 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 51/100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:42 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:42.490485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:42.495258 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:42.503145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.503850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.504464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.505156 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:42.505614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:42.506016 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:42.901595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:42.922290 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:42.924428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:42.926832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-026e5cc7-44e8-425b-ad66-11e36b453cfc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.553305 Sep 12 23:28:42.927399 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 50/101] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:42 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:28:42.938076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:42.943422 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:42.950180 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3c07b0ec-b897-45a2-a18a-6a2bb41b3c27 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.467595 Sep 12 23:28:42.951755 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 52/102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:42 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:43.369640 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:43.370471 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:43.381774 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:43.383454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:43.386089 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:43.390200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:43.391463 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:43.394221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:43.449654 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:43.506100 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:43.506912 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:43.519472 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:43.521344 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:43.523980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:43.525780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:43.526798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:43.527382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:43.568877 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:43.576778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dd7d169c-27ff-4c71-a76d-d4ddf6d8777e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1280 microversion: 2.1 time: 0.211743 Sep 12 23:28:43.588662 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 51/103] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:43 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:44.013708 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-524e27d8-b8e3-40c5-b98a-543e2b12b843 req-ddc8dae7-85e1-4a7f-8165-e0827a4f8ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbaafcd0-103d-4e1a-a15e-fc8997acceef", "tag": "f432d2c4-e8e1-4abe-b933-41ca765c4f52"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:44.054805 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-524e27d8-b8e3-40c5-b98a-543e2b12b843 req-ddc8dae7-85e1-4a7f-8165-e0827a4f8ec0 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.056541 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-524e27d8-b8e3-40c5-b98a-543e2b12b843 req-ddc8dae7-85e1-4a7f-8165-e0827a4f8ec0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.057213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-524e27d8-b8e3-40c5-b98a-543e2b12b843 req-ddc8dae7-85e1-4a7f-8165-e0827a4f8ec0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.127077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-524e27d8-b8e3-40c5-b98a-543e2b12b843 req-ddc8dae7-85e1-4a7f-8165-e0827a4f8ec0 service nova] Creating event network-changed:f432d2c4-e8e1-4abe-b933-41ca765c4f52 for instance bbaafcd0-103d-4e1a-a15e-fc8997acceef on hv-cinder-85200 Sep 12 23:28:44.127821 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-524e27d8-b8e3-40c5-b98a-543e2b12b843 req-ddc8dae7-85e1-4a7f-8165-e0827a4f8ec0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120622) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 23:28:44.128262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-524e27d8-b8e3-40c5-b98a-543e2b12b843 req-ddc8dae7-85e1-4a7f-8165-e0827a4f8ec0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120622) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 23:28:44.129322 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.138485 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.139197 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.140189 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.140791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.141405 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.163826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.compute.rpcapi [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 23:28:44.164725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] Releasing lock "compute-rpcapi-router" {{(pid=120622) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 23:28:44.187657 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:44.200870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8fab3851-3cec-4822-b306-9aca4082d48e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.698877 Sep 12 23:28:44.217415 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 53/104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:43 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:44.221275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-64839ca7-6ec2-4846-adf5-11784e355fce None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356084 Sep 12 23:28:44.225292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:44.227468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 52/105] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:28:44.232054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:44.253913 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:44.259818 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:44.276759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.279627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.280765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.281831 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.286189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.286926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.294659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.297852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.304770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.305963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.310935 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.311695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.808849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:44.821279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:44.832157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:44.833818 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7ec8b1ac-af07-4d0f-9c1c-9b801c9e254f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.614944 Sep 12 23:28:44.834596 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 54/106] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:44 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:44.843691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:44.845139 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:44.855382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.857048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.858490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:44.861093 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:44.861760 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:44.862723 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:45.013164 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:45.024164 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0ff0be54-b6c7-4b6e-8fde-67910c7fbaa7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1280 microversion: 2.1 time: 0.187416 Sep 12 23:28:45.032793 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:44 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:45.236157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:45.240063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:45.253704 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:45.254307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:45.254964 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:45.256155 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:45.259547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:45.261801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:45.358500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:45.372217 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e467c80b-5c34-4bc9-a6e3-1e5b950cc844 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 1.141993 Sep 12 23:28:45.389568 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 53/108] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:44 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:45.492995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-26fad6f7-1100-4208-8ce1-a08e7001f79b req-487639be-6354-40f1-a68b-15c97230810b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e922a5d-06e3-456e-ac49-64d6c3aba117", "tag": "262242d2-62b5-4e29-8759-130e6a7786d0"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:45.527766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-26fad6f7-1100-4208-8ce1-a08e7001f79b req-487639be-6354-40f1-a68b-15c97230810b service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:45.528418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-26fad6f7-1100-4208-8ce1-a08e7001f79b req-487639be-6354-40f1-a68b-15c97230810b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:45.528736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-26fad6f7-1100-4208-8ce1-a08e7001f79b req-487639be-6354-40f1-a68b-15c97230810b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:45.553774 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-26fad6f7-1100-4208-8ce1-a08e7001f79b req-487639be-6354-40f1-a68b-15c97230810b service nova] Creating event network-changed:262242d2-62b5-4e29-8759-130e6a7786d0 for instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 on hv-cinder-85200 Sep 12 23:28:45.580211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-26fad6f7-1100-4208-8ce1-a08e7001f79b req-487639be-6354-40f1-a68b-15c97230810b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083965 Sep 12 23:28:45.580211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 54/109] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:28:45.865450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:45.866844 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:45.877000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:45.878505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:45.879164 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:45.880399 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:45.881239 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:45.881949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:45.983059 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:45.993666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-84a28a8d-6e8b-4148-972a-849aee5be2dc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.772197 Sep 12 23:28:45.995240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 56/110] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:45 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:46.049490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:46.052970 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:46.071081 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:46.071943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:46.072817 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:46.073936 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:46.074699 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:46.075272 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:46.412370 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:46.423309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aee5d6aa-565a-4110-a187-0216fd653e46 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.378875 Sep 12 23:28:46.424128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 57/111] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:46 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:46.440387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:46.441324 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:46.455333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:46.455945 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:46.456460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:46.457518 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:46.458117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:46.458542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:46.728870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:46.738624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bbd76866-8c7f-4822-9d7b-e2ff0d6088b4 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.313107 Sep 12 23:28:46.739187 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 58/112] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:46 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:46.860626 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:46.874261 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1808032658", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "networks": [{"uuid": "b00c67d0-ddbb-4c24-ae7c-fa1370f53f73"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:46.877656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:46.879925 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:46.881770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a1eeb4ca-34c3-4ff2-b3c6-1a30a4695df8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 1.021194 Sep 12 23:28:46.883692 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 55/113] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:45 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:28:46.972109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] validate_networks() for [('b00c67d0-ddbb-4c24-ae7c-fa1370f53f73', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:28:47.020375 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:47.022021 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:47.036791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.037204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.037647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:47.038364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.038821 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.039246 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:47.606284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:28:47.606949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:28:47.607412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:28:47.608128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:28:47.608780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:28:47.625426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.625426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.625426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:47.625980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.626524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.627175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:47.650234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Getting quotas for project 641b6882f873400fbef301fc5ce82391. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:28:47.659821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Getting quotas for user 2dcd3dd65d5841049ed20e36e847bb53 and project 641b6882f873400fbef301fc5ce82391. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:28:47.673286 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:28:47.676892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:28:47.753569 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7df200bf-43f5-4550-a8ec-a56253d7310c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883168 Sep 12 23:28:47.757220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 59/114] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:28:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:28:47.769810 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:47.770997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:47.787267 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.787806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.788426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:47.789324 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.790359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.790934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:47.881402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:47.893745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cffa6435-c69c-45bc-9f77-f46a62895546 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.873031 Sep 12 23:28:47.905093 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 56/115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:47 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:47.943650 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:47.944604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:47.968549 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.969830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.977393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:47.984349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:47.985163 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:47.985750 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:48.013086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:48.037604 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-84df5ae9-422a-4bf2-8f26-bfb515258d34 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.276546 Sep 12 23:28:48.042509 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 60/116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:47 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:48.050430 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dc04c4ca-98db-4097-979c-5c20c26d9ee9 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:48.051162 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dc04c4ca-98db-4097-979c-5c20c26d9ee9 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:48.243359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-dc04c4ca-98db-4097-979c-5c20c26d9ee9 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:48.253339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dc04c4ca-98db-4097-979c-5c20c26d9ee9 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1214 microversion: 2.1 time: 0.209288 Sep 12 23:28:48.255739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 61/117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:48 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:48.263164 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:48.263800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:48.313468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:48.315174 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:48.315174 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:48.315814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:48.324125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:48.325086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:48.579104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:48.590999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b1c3b5e0-a559-40a8-b6da-44a989856113 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.681246 Sep 12 23:28:48.592396 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 57/118] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:47 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:48.682874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-5e1a1cc6-a605-4220-8b96-01891e4fe53b req-30e96bdd-0807-4baf-bcd4-f10425918a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d4dcb-1679-4627-b94b-adc34cfffbb3", "name": "network-vif-plugged", "status": "completed", "tag": "fbdc10fe-ce53-41fd-a771-18e381482273"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:48.700021 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5e1a1cc6-a605-4220-8b96-01891e4fe53b req-30e96bdd-0807-4baf-bcd4-f10425918a05 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:48.700452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5e1a1cc6-a605-4220-8b96-01891e4fe53b req-30e96bdd-0807-4baf-bcd4-f10425918a05 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:48.701906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5e1a1cc6-a605-4220-8b96-01891e4fe53b req-30e96bdd-0807-4baf-bcd4-f10425918a05 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:48.723157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-5e1a1cc6-a605-4220-8b96-01891e4fe53b req-30e96bdd-0807-4baf-bcd4-f10425918a05 service nova] Creating event network-vif-plugged:fbdc10fe-ce53-41fd-a771-18e381482273 for instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 on hv-cinder-85200 Sep 12 23:28:48.729191 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-5e1a1cc6-a605-4220-8b96-01891e4fe53b req-30e96bdd-0807-4baf-bcd4-f10425918a05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121143 Sep 12 23:28:48.736194 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 58/119] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:48.850890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:48.863459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:48.866463 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:48.871515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-63c13d3b-1956-4730-82bb-ec9e162c5f6a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.613571 Sep 12 23:28:48.875452 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 62/120] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:48 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:48.922518 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:48.926823 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:48.937128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:48.939307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:48.939807 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:48.940551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:48.943673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:48.944121 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.017838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-34fd6754-28e8-409d-ac53-0dc7ed2a56c5 req-9f7f88af-183b-49e3-a961-6bbf687bcd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1398a779-68bf-4ec4-b196-d359ee0e7b8c", "tag": "3bbf415e-a5cc-43c6-bf78-c5caf098ad4d"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:49.028308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-34fd6754-28e8-409d-ac53-0dc7ed2a56c5 req-9f7f88af-183b-49e3-a961-6bbf687bcd05 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.028787 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-34fd6754-28e8-409d-ac53-0dc7ed2a56c5 req-9f7f88af-183b-49e3-a961-6bbf687bcd05 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.029209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-34fd6754-28e8-409d-ac53-0dc7ed2a56c5 req-9f7f88af-183b-49e3-a961-6bbf687bcd05 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.049746 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-34fd6754-28e8-409d-ac53-0dc7ed2a56c5 req-9f7f88af-183b-49e3-a961-6bbf687bcd05 service nova] Creating event network-changed:3bbf415e-a5cc-43c6-bf78-c5caf098ad4d for instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c on hv-cinder-85200 Sep 12 23:28:49.056919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-34fd6754-28e8-409d-ac53-0dc7ed2a56c5 req-9f7f88af-183b-49e3-a961-6bbf687bcd05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043708 Sep 12 23:28:49.058024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 63/121] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:49.064911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:49.065971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:49.071951 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.072622 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.073229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.074118 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.074635 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.075121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.207006 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:49.215095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-81ddc570-f32f-4678-8359-5f8810619f55 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.155775 Sep 12 23:28:49.215682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 64/122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:49 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:49.285007 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:49.285738 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:49.291520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.292046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.292484 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.293178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.293621 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.294044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.362092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:49.363295 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:49.370178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e6af47ac-3969-43f1-9b30-4050bb7f25cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1266 microversion: 2.1 time: 0.089717 Sep 12 23:28:49.370750 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 65/123] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:49 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:49.374165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ceffa590-aeb8-4359-b79c-b5e791d3a8db tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.456794 Sep 12 23:28:49.375145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 59/124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:48 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:49.614253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:49.615150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:49.622255 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.622985 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.623661 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.624570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.625254 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.625871 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.871082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:49.881870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-061a3101-aaf2-472e-9714-814b5cf0572e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.271308 Sep 12 23:28:49.884544 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 66/125] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:49 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:49.902694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:49.903082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:49.917685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.918262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.918692 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:49.919347 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:49.929591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:49.930208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.142542 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:50.153298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:50.155794 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:50.157668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6685eaaf-0764-49a3-8ea6-4b294f24f22b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.259654 Sep 12 23:28:50.158743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 60/126] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:49 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:50.241902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:50.242768 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:50.249895 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.250465 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.250889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.251599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.252089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.252571 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.396426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:50.397072 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:50.409956 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.410684 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.411618 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.412628 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.415892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.416522 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.438370 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:50.451404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-75712552-4cc9-44c3-875b-dbd542577654 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.215118 Sep 12 23:28:50.452034 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 67/127] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:50 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:50.468168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:50.468168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:50.472640 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.473116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.473897 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.474786 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.475409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.475995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.919390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:50.929259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4c6f2f81-c4f6-4f53-866c-648cd014df35 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1266 microversion: 2.1 time: 0.538855 Sep 12 23:28:50.954733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 61/128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:50 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1266 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:50.954733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:50.954733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:50.964087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.964591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.965033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.966151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:50.966250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:50.967068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:50.993332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:51.007591 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ffa46941-c175-49ed-8423-4cce4ec4a6df tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.544742 Sep 12 23:28:51.008900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 68/129] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:50 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:51.099136 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-25de4658-aa56-4ce4-be19-a1752f54b716 req-5a022009-5e64-43ac-8d39-b244939f8653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a461aa66-7b30-46ee-a5d1-2a48540d585a", "tag": "1a3abf75-9e9d-4acc-9edb-526d5e849d0e"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:51.111092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-25de4658-aa56-4ce4-be19-a1752f54b716 req-5a022009-5e64-43ac-8d39-b244939f8653 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:51.112099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-25de4658-aa56-4ce4-be19-a1752f54b716 req-5a022009-5e64-43ac-8d39-b244939f8653 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:51.112744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-25de4658-aa56-4ce4-be19-a1752f54b716 req-5a022009-5e64-43ac-8d39-b244939f8653 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:51.125909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-25de4658-aa56-4ce4-be19-a1752f54b716 req-5a022009-5e64-43ac-8d39-b244939f8653 service nova] Creating event network-changed:1a3abf75-9e9d-4acc-9edb-526d5e849d0e for instance a461aa66-7b30-46ee-a5d1-2a48540d585a on hv-cinder-85200 Sep 12 23:28:51.133665 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-25de4658-aa56-4ce4-be19-a1752f54b716 req-5a022009-5e64-43ac-8d39-b244939f8653 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038828 Sep 12 23:28:51.134962 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 69/130] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:28:51.185332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:51.186148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:51.196068 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:51.197232 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:51.197980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:51.201246 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:51.202892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:51.206024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:51.447428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:51.459445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ef62f42d-b072-4421-a340-d69797388c82 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.514233 Sep 12 23:28:51.460119 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 62/131] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:50 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:51.476079 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:51.476920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:51.488762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:51.489263 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:51.489704 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:51.490405 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:51.490857 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:51.496365 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:51.558002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:51.586556 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:51.586556 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:51.598387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-277319df-1828-4afd-bd95-e2c49d355164 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1407 microversion: 2.20 time: 0.417796 Sep 12 23:28:51.599008 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 70/132] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:51 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:28:51.882289 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:51.892978 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-152a1021-1b43-4943-a306-1d19935c0d2d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.420677 Sep 12 23:28:51.894595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 63/133] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:51 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:51.962129 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:51.962830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:51.973116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:51.973613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:51.974054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:51.974748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:51.975205 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:51.975658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.039360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:52.040054 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:52.046661 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.047970 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.048727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.050092 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.050790 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.051418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.333587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:52.358254 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cb6e0b2a-dca0-41d8-8411-bc28275c6297 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.399333 Sep 12 23:28:52.367725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:52.374783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 71/134] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:51 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:52.376782 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2a2cf1c8-d907-488f-b695-2b92a49f832a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.341018 Sep 12 23:28:52.396337 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-023defb6-6c95-434a-ae2f-0a39b93d3a3d req-c8bba03a-6cbe-49a4-a727-df7611787755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e922a5d-06e3-456e-ac49-64d6c3aba117", "name": "network-vif-plugged", "status": "completed", "tag": "262242d2-62b5-4e29-8759-130e6a7786d0"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:52.404333 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 64/135] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:52 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:52.418798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-023defb6-6c95-434a-ae2f-0a39b93d3a3d req-c8bba03a-6cbe-49a4-a727-df7611787755 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.419272 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-023defb6-6c95-434a-ae2f-0a39b93d3a3d req-c8bba03a-6cbe-49a4-a727-df7611787755 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.420846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-023defb6-6c95-434a-ae2f-0a39b93d3a3d req-c8bba03a-6cbe-49a4-a727-df7611787755 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.434992 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-023defb6-6c95-434a-ae2f-0a39b93d3a3d req-c8bba03a-6cbe-49a4-a727-df7611787755 service nova] Creating event network-vif-plugged:262242d2-62b5-4e29-8759-130e6a7786d0 for instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 on hv-cinder-85200 Sep 12 23:28:52.443447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-023defb6-6c95-434a-ae2f-0a39b93d3a3d req-c8bba03a-6cbe-49a4-a727-df7611787755 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063814 Sep 12 23:28:52.444311 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 72/136] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:52.491864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:52.492487 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:52.502423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.503607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.504039 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.504738 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.505185 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.505680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.625102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:52.625972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:52.640108 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.641454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.642082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.644598 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.645383 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.645941 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.656108 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:52.738188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:52.750960 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8a502f7b-8372-43fa-8a52-8353d44c633b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.262988 Sep 12 23:28:52.755050 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 65/137] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:52 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:52.833864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:52.843259 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:52.844790 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:52.845952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fa85ab8e-2c66-435f-a717-06934f1a6e42 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1599 microversion: 2.20 time: 0.225662 Sep 12 23:28:52.846500 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 73/138] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:28:52 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:28:52.870900 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:52.871386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:52.877818 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.878298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.878727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.879399 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.879883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.880298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.925259 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:52.926200 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:52.931830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.932316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.932746 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.933425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:52.933868 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:52.934282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:52.992243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cac51084-ee4f-4c1d-8ddb-dbbc9a7e0bff tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.125137 Sep 12 23:28:52.992835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 66/139] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Sep 12 23:28:52 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:28:53.061199 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:53.070386 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fb08da90-7297-43b8-a126-ce12b66500e0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.148814 Sep 12 23:28:53.085260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 74/140] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:52 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:53.385891 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:53.386561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:53.393244 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:53.393770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:53.394247 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:53.394976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:53.395450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:53.395917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:53.408507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:53.409133 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:53.415821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:53.416307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:53.416905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:53.417739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:53.418336 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:53.418926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:53.557429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:53.565809 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-eb962d39-ab0f-4ab1-b43c-85f2d74ea663 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.161876 Sep 12 23:28:53.566393 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 75/141] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:53 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:53.777249 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:53.777848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:53.798720 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:53.799216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:53.805150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:53.805895 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:53.806361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:53.806792 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:53.853239 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:53.862955 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-efe933c8-22da-42ad-a073-1d40afca22bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.480990 Sep 12 23:28:53.863528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 67/142] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:53 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:53.938234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:53.945928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6cf394b8-5ce7-4345-a705-358483217f35 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.172743 Sep 12 23:28:53.946499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 76/143] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:53 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:54.095376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:54.096029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:54.102141 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.102621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.103045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.103815 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.104262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.104728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.163011 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:54.304853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:54.312964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b3e5027b-cf39-407a-968f-c66abff03f22 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.220907 Sep 12 23:28:54.313759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 68/144] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:54 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:54.445321 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-53035984-afe3-44d0-9501-137104e8f6fa req-334bb1cc-e7af-4dfe-b3f4-ecd8b8bb0b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07d4dcb-1679-4627-b94b-adc34cfffbb3", "tag": "fbdc10fe-ce53-41fd-a771-18e381482273"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:54.455173 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-53035984-afe3-44d0-9501-137104e8f6fa req-334bb1cc-e7af-4dfe-b3f4-ecd8b8bb0b54 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.455800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-53035984-afe3-44d0-9501-137104e8f6fa req-334bb1cc-e7af-4dfe-b3f4-ecd8b8bb0b54 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.456342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-53035984-afe3-44d0-9501-137104e8f6fa req-334bb1cc-e7af-4dfe-b3f4-ecd8b8bb0b54 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.467442 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-53035984-afe3-44d0-9501-137104e8f6fa req-334bb1cc-e7af-4dfe-b3f4-ecd8b8bb0b54 service nova] Creating event network-changed:fbdc10fe-ce53-41fd-a771-18e381482273 for instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 on hv-cinder-85200 Sep 12 23:28:54.473179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-53035984-afe3-44d0-9501-137104e8f6fa req-334bb1cc-e7af-4dfe-b3f4-ecd8b8bb0b54 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 Sep 12 23:28:54.474116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 77/145] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:54.588814 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:54.589427 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:54.595825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.596310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.596736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.597413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.597850 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.598276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.740497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:54.744064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:54.750252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-162b49d0-7b14-4c3a-a774-8c787603ed7b tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.165092 Sep 12 23:28:54.750852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 69/146] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:54 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:54.886384 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:54.887237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:54.890992 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:54.897314 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.897798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.898223 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.899058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.899710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.900170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.970340 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:54.971068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:54.977028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.977754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.978257 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:54.979052 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:54.979596 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:54.980148 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:55.045077 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:55.054158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5df55511-e7f3-4197-a24e-45a5a33f5d67 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.171948 Sep 12 23:28:55.054865 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 78/147] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:54 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:55.116446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:55.124194 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-da14dd26-9094-4ee4-ae96-d34d56dcb2e9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.158789 Sep 12 23:28:55.124801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 70/148] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:54 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:55.336116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:55.336756 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:55.343176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:55.344243 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:55.344712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:55.345450 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:55.345904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:55.346369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:55.480844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:55.488520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a4b74dd5-ae41-4b85-87a8-f21d0b85550c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.156580 Sep 12 23:28:55.489082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 79/149] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:55 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:55.774265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:55.778608 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:55.788424 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:55.789219 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:55.790297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:55.791807 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:55.792297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:55.792749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:55.992883 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-380ea603-3a51-467b-ab44-f2eb91de4a5c req-7234235a-dd85-4cc7-87ba-6da0f9b5396f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbaafcd0-103d-4e1a-a15e-fc8997acceef", "name": "network-vif-plugged", "status": "completed", "tag": "f432d2c4-e8e1-4abe-b933-41ca765c4f52"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:56.009136 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-380ea603-3a51-467b-ab44-f2eb91de4a5c req-7234235a-dd85-4cc7-87ba-6da0f9b5396f service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.009614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-380ea603-3a51-467b-ab44-f2eb91de4a5c req-7234235a-dd85-4cc7-87ba-6da0f9b5396f service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.010062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-380ea603-3a51-467b-ab44-f2eb91de4a5c req-7234235a-dd85-4cc7-87ba-6da0f9b5396f service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.012496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:56.043977 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-16d2ec7d-b18c-45ab-ac1f-f33260940db5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.272567 Sep 12 23:28:56.045002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 71/150] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:55 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:56.049076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-380ea603-3a51-467b-ab44-f2eb91de4a5c req-7234235a-dd85-4cc7-87ba-6da0f9b5396f service nova] Creating event network-vif-plugged:f432d2c4-e8e1-4abe-b933-41ca765c4f52 for instance bbaafcd0-103d-4e1a-a15e-fc8997acceef on hv-cinder-85200 Sep 12 23:28:56.058223 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-380ea603-3a51-467b-ab44-f2eb91de4a5c req-7234235a-dd85-4cc7-87ba-6da0f9b5396f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069173 Sep 12 23:28:56.058960 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 80/151] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:28:56.077030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:56.078243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:56.086151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.086869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.087511 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.088568 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.089116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.089779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.149066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:56.150041 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:56.157810 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.158376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.159029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.161592 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.162211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.162838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.274329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:56.284258 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-59d38dc6-c4ef-49e4-ba26-75e0ef7a228f tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.211043 Sep 12 23:28:56.284823 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 72/152] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:56 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:56.388637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:56.410888 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-88094c37-3257-4bcf-80e6-de9379ece04b tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.266064 Sep 12 23:28:56.411879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 81/153] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:56 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:56.515138 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:56.516360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:56.522920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.523447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.523969 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.524662 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.525152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.525680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.544155 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-2ae633ce-c9a8-48a9-9718-b7b108e48319 req-cce1a74c-04f4-4acc-acc4-00f8c1aa18eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc907ee-49c2-4621-b309-f687358b0cb7", "tag": "caa88b03-6ce8-4395-afa3-e6a8043de3f7"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:28:56.554397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2ae633ce-c9a8-48a9-9718-b7b108e48319 req-cce1a74c-04f4-4acc-acc4-00f8c1aa18eb service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:56.554949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2ae633ce-c9a8-48a9-9718-b7b108e48319 req-cce1a74c-04f4-4acc-acc4-00f8c1aa18eb service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:56.555384 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2ae633ce-c9a8-48a9-9718-b7b108e48319 req-cce1a74c-04f4-4acc-acc4-00f8c1aa18eb service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:56.577920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-2ae633ce-c9a8-48a9-9718-b7b108e48319 req-cce1a74c-04f4-4acc-acc4-00f8c1aa18eb service nova] Creating event network-changed:caa88b03-6ce8-4395-afa3-e6a8043de3f7 for instance 3fc907ee-49c2-4621-b309-f687358b0cb7 on hv-cinder-85200 Sep 12 23:28:56.583080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-2ae633ce-c9a8-48a9-9718-b7b108e48319 req-cce1a74c-04f4-4acc-acc4-00f8c1aa18eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043023 Sep 12 23:28:56.583890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 82/154] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:28:56.664602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:56.672307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8d11f2db-fd30-44c7-bac1-387e7b591e6c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.163502 Sep 12 23:28:56.672880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 73/155] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:56 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:57.066675 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:57.067487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:57.073426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.073911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.074342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.075013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.075464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.075909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.202678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:57.210156 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3512f875-6cc3-4847-b164-5426c8793d4f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.148453 Sep 12 23:28:57.210707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 83/156] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:57 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:57.306152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:57.306749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:57.313060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.313183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.313681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.314355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.314798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.315212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.434248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:57.434885 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:57.450586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:57.450961 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.451459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.451921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.452612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.453691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.454109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.459069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2b9e5b01-7e74-453b-8093-75c7bbf73641 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.156631 Sep 12 23:28:57.459771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 74/157] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:57 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:57.585154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:57.592745 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f107b4fa-3dc1-45cb-be77-39516cc87180 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.162375 Sep 12 23:28:57.593297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 84/158] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:57 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:57.694214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:57.694856 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:57.700903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.701338 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.701778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.702464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:57.703556 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:57.704335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:57.833313 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:57.840764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-fa2a5cd8-a7cc-467b-b00c-f7fe41263eff tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.150477 Sep 12 23:28:57.841319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 75/159] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:57 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:58.232357 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:58.232992 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:58.235538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:58.240872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.241352 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.241781 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:58.242459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.242904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.243321 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:58.257672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:28:58.373136 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:58.381414 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8209582a-cb44-45c7-9358-877c8b121370 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.152820 Sep 12 23:28:58.382024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 85/160] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:58 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:58.483250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:58.484230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:58.490298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.490778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.491203 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:58.491937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.492407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.492816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:58.614870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:58.615531 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:58.622142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.622689 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.623356 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:58.624877 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.626037 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.626668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:58.658188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:58.678425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-277708a5-0389-46dd-adbf-b7b3d051b66d tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.199198 Sep 12 23:28:58.679152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 76/161] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:58 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:58.765669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:58.773507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1f551db6-9329-4c32-90a5-a35a34aed8fd tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.162978 Sep 12 23:28:58.774086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 86/162] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:58 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:28:58.863270 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:58.863981 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:58.876358 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.876358 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.876358 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:58.876358 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:58.876729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:58.876729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:59.021381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:59.029235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0df4ac14-8d21-4f34-9015-a873968d0507 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.170389 Sep 12 23:28:59.029806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 77/163] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:58 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:28:59.406531 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:59.407441 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:59.418347 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:59.419476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:59.421930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:59.423171 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:59.423658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:59.424107 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:59.706892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:28:59.707587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:28:59.714883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:59.715424 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:59.722969 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:59.724872 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:28:59.725701 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:28:59.726281 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:28:59.971327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:28:59.998742 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-28d151f5-83aa-4d56-ab2d-4732fcd3ee37 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.597674 Sep 12 23:29:00.000186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 87/164] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:59 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:00.005512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:00.007480 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:00.025280 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:00.026093 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:00.026728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:00.032613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:00.034705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:00.035324 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:00.200348 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:00.203271 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:00.208026 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c1489c59-2388-4328-9994-b68d1c30fe3c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.508732 Sep 12 23:29:00.208797 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 78/165] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:28:59 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:00.213114 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2801e4b0-0e9a-4992-84ee-c78450137c52 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.210268 Sep 12 23:29:00.213420 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:00.214095 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:00.234600 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:00.235211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:00.235755 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:00.236638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:00.237179 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:00.238089 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:00.238631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 88/166] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:00 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:00.375558 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:00.383551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4e12b0a1-c374-4ed2-a20f-f4b45f31e7fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.173797 Sep 12 23:29:00.384213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 79/167] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:00 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:00.762423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-a7c86b23-f6b3-4d75-8eda-0824ff65fb3d req-a4294b7d-5b81-4ae1-bc7a-221f0b0152db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a461aa66-7b30-46ee-a5d1-2a48540d585a", "name": "network-vif-plugged", "status": "completed", "tag": "1a3abf75-9e9d-4acc-9edb-526d5e849d0e"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:00.774027 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a7c86b23-f6b3-4d75-8eda-0824ff65fb3d req-a4294b7d-5b81-4ae1-bc7a-221f0b0152db service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:00.774832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a7c86b23-f6b3-4d75-8eda-0824ff65fb3d req-a4294b7d-5b81-4ae1-bc7a-221f0b0152db service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:00.775379 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a7c86b23-f6b3-4d75-8eda-0824ff65fb3d req-a4294b7d-5b81-4ae1-bc7a-221f0b0152db service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:00.790424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-a7c86b23-f6b3-4d75-8eda-0824ff65fb3d req-a4294b7d-5b81-4ae1-bc7a-221f0b0152db service nova] Creating event network-vif-plugged:1a3abf75-9e9d-4acc-9edb-526d5e849d0e for instance a461aa66-7b30-46ee-a5d1-2a48540d585a on hv-cinder-85200 Sep 12 23:29:00.797268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-a7c86b23-f6b3-4d75-8eda-0824ff65fb3d req-a4294b7d-5b81-4ae1-bc7a-221f0b0152db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038294 Sep 12 23:29:00.797865 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 89/168] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:01.026069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:01.026874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:01.033412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.033897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.034332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.035025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.035491 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.035951 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.235140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:01.236184 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:01.248954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.250795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.251437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.253641 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.254249 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.255402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.286133 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:01.296172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1ae19b40-4a78-43b1-a423-670dc57e36c5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1363 microversion: 2.1 time: 0.274232 Sep 12 23:29:01.313642 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 80/169] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:01 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:01.326718 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:01.332006 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:01.340164 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.340893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.341504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.352406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.352947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.356816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.474397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:01.483136 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-475d43e2-7133-4595-8785-42a1db584784 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.254162 Sep 12 23:29:01.499744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 90/170] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:01 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:01.506493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:01.507482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:01.513639 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.514253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.514700 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.515930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:01.516382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:01.516799 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:01.528972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:01.537619 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-766484b1-3260-45cc-a9ec-8996779a359a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1315 microversion: 2.1 time: 0.217733 Sep 12 23:29:01.538435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 81/171] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:01 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:01.673273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:01.684190 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-95aafd3d-83ff-4793-b5ce-59665c2a7a0d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.182963 Sep 12 23:29:01.685569 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 91/172] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:01 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:02.326343 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:02.326929 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:02.333482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.333852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.334395 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.334942 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.335395 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.335829 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.473297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:02.481668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1433b38f-cc75-4963-8b76-01453302d87a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1549 microversion: 2.1 time: 0.159177 Sep 12 23:29:02.482259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 82/173] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:02 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:02.506198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:02.507313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:02.517586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:02.519496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.520185 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.520904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.521760 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.522341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.522905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.523774 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:02.540075 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.540864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.541972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.552552 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.553214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.554404 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.620575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:02.687491 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ce61f859-c8f7-4988-b87f-ad2fa78259f7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184572 Sep 12 23:29:02.695353 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 92/174] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:29:02 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:02.708225 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:02.709088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:02.715827 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.716489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.717054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.718099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.718717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.719418 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.945126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:02.957140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2319a54d-90c5-40f6-bb8b-d3b54c045fb8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.443822 Sep 12 23:29:02.974572 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 83/175] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:02 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:02.980088 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:02.980946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:02.988391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.989376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.990046 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:02.991175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:02.991760 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:02.992913 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:03.031824 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:03.041098 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c85c53ff-1879-423b-99d1-bccc4cd251b9 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1501 microversion: 2.1 time: 0.344423 Sep 12 23:29:03.041978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 93/176] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:02 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:03.083109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-c125e187-8ebf-4901-99c2-2b4b628bdc55 req-f7de439f-303e-40c5-a740-4d0c402d04d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1398a779-68bf-4ec4-b196-d359ee0e7b8c", "name": "network-vif-plugged", "status": "completed", "tag": "3bbf415e-a5cc-43c6-bf78-c5caf098ad4d"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:03.098307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c125e187-8ebf-4901-99c2-2b4b628bdc55 req-f7de439f-303e-40c5-a740-4d0c402d04d8 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:03.099090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c125e187-8ebf-4901-99c2-2b4b628bdc55 req-f7de439f-303e-40c5-a740-4d0c402d04d8 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:03.099616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c125e187-8ebf-4901-99c2-2b4b628bdc55 req-f7de439f-303e-40c5-a740-4d0c402d04d8 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:03.113618 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-c125e187-8ebf-4901-99c2-2b4b628bdc55 req-f7de439f-303e-40c5-a740-4d0c402d04d8 service nova] Creating event network-vif-plugged:3bbf415e-a5cc-43c6-bf78-c5caf098ad4d for instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c on hv-cinder-85200 Sep 12 23:29:03.120168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-c125e187-8ebf-4901-99c2-2b4b628bdc55 req-f7de439f-303e-40c5-a740-4d0c402d04d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052510 Sep 12 23:29:03.121020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 94/177] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:03.313590 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:03.321946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0aea6a93-2c70-4a8e-b71d-a5e7ef65eee2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.345859 Sep 12 23:29:03.330082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 84/178] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:02 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:03.985557 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:03.986250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:03.994354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:03.995302 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:03.995894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:03.997440 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:03.998101 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:03.998662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:04.362472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:04.363089 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:04.370242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:04.386799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:04.387472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:04.388270 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:04.388734 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:04.389153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:04.414537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:04.424284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-953ad0cb-f54c-4f7c-9401-ee733384d302 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.445501 Sep 12 23:29:04.425143 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 95/179] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:03 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:04.436367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-b8dde8bd-d29e-4122-9d65-8d5f46dbba5e req-ca52de4a-5204-4258-850f-7f25cf3cdb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbaafcd0-103d-4e1a-a15e-fc8997acceef", "tag": "f432d2c4-e8e1-4abe-b933-41ca765c4f52"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:04.446587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b8dde8bd-d29e-4122-9d65-8d5f46dbba5e req-ca52de4a-5204-4258-850f-7f25cf3cdb0b service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:04.447220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b8dde8bd-d29e-4122-9d65-8d5f46dbba5e req-ca52de4a-5204-4258-850f-7f25cf3cdb0b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:04.447668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b8dde8bd-d29e-4122-9d65-8d5f46dbba5e req-ca52de4a-5204-4258-850f-7f25cf3cdb0b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:04.462284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-b8dde8bd-d29e-4122-9d65-8d5f46dbba5e req-ca52de4a-5204-4258-850f-7f25cf3cdb0b service nova] Creating event network-changed:f432d2c4-e8e1-4abe-b933-41ca765c4f52 for instance bbaafcd0-103d-4e1a-a15e-fc8997acceef on hv-cinder-85200 Sep 12 23:29:04.469595 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-b8dde8bd-d29e-4122-9d65-8d5f46dbba5e req-ca52de4a-5204-4258-850f-7f25cf3cdb0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042805 Sep 12 23:29:04.470443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 96/180] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:04.533367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:04.541308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c9703db2-1f98-4685-bb8c-a1a5e6f6786c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1322 microversion: 2.1 time: 0.184174 Sep 12 23:29:04.541879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 85/181] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:04 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:04.718823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "febb5968-139a-4839-950f-e1b9b9ee4130"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:04.721292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:04.727236 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:04.727750 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:04.728173 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:04.728848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:04.729292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:04.729708 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.450502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:05.451146 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:05.453630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=97 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:05.460248 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.460747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.461320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.462091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.462525 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.462945 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.483000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:05.598172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:05.605754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-fdbe77a9-f7bc-40c4-9e97-f58a3ab94b91 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.162273 Sep 12 23:29:05.606316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 86/182] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:05 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:05.610687 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:05.611285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:05.616824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.617308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.617745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.618426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.618876 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.619297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.752282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:05.759910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-54c311b8-eb4b-4745-af88-79a8b198b3cb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1516 microversion: 2.1 time: 0.152578 Sep 12 23:29:05.760405 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 87/183] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:05 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:05.783202 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:05.785530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:05.791418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.791929 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.792355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.793020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.793464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.793876 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.816638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lazy-loading 'flavor' on Instance uuid a461aa66-7b30-46ee-a5d1-2a48540d585a {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:05.932135 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ccad3ad6-15dd-44c9-bfd3-ad94bf5453ef tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a/action" status: 200 len: 32 microversion: 2.1 time: 0.153042 Sep 12 23:29:05.932763 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 88/184] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:29:05 2022] POST /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 12 23:29:05.942316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:05.943004 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:05.948937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.949421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.949855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:05.950540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:05.950991 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:05.951414 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:06.075713 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:06.084131 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2ae5de97-ca09-4504-84e3-dca5d8ad70a8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.145868 Sep 12 23:29:06.084694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 89/185] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:05 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:06.628008 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:06.628568 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:06.634431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:06.634917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:06.635345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:06.636105 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:06.636515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:06.637010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:06.778594 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:06.787130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-537c4a1b-ae01-4f0c-a58c-4784d8730108 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.163095 Sep 12 23:29:06.787719 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 90/186] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:06 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:07.107839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:07.108446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:07.114691 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:07.115184 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:07.115653 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:07.116339 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:07.116788 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:07.117208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:07.243102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:07.250690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-366e98de-7763-4ca4-a057-06970abeb4de tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.146757 Sep 12 23:29:07.251259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 91/187] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:07 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:07.809355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:07.809964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:07.816753 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:07.817237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:07.817667 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:07.818343 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:07.818793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:07.819220 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:07.946159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:07.953758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3457c154-a48f-4762-b6e1-877c126fcf5a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.148218 Sep 12 23:29:07.954306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 92/188] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:07 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:08.273809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:08.274411 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:08.280581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:08.281053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:08.281486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:08.282181 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:08.282611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:08.283024 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:08.417340 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:08.425792 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9a885494-0968-4d9d-99f8-42a78f7f56ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.155938 Sep 12 23:29:08.426382 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 93/189] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:08 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:08.976524 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:08.977131 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:08.982997 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:08.984008 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:08.984602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:08.985283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:08.985735 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:08.986157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:09.157526 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:09.165497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-386b8a18-d8af-4f10-831a-02444e91d7bc tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.192739 Sep 12 23:29:09.166235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 94/190] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:08 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:09.452047 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:09.453505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:09.459099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-087d8bf3-3d11-42bb-b1e4-882434825419 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "POST /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.744373 Sep 12 23:29:09.462619 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:09.463085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 97/191] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:29:04 2022] POST /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117/os-volume_attachments => generated 194 bytes in 4749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:09.464519 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:09.466663 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:09.470593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:09.471552 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:09.472206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:09.956843 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-d6f1f2c9-bd63-4853-9491-151866d48809 req-f3b90678-9a2f-4e80-aca0-5167067d8651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc907ee-49c2-4621-b309-f687358b0cb7", "name": "network-vif-plugged", "status": "completed", "tag": "caa88b03-6ce8-4395-afa3-e6a8043de3f7"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:09.969847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d6f1f2c9-bd63-4853-9491-151866d48809 req-f3b90678-9a2f-4e80-aca0-5167067d8651 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:09.970484 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d6f1f2c9-bd63-4853-9491-151866d48809 req-f3b90678-9a2f-4e80-aca0-5167067d8651 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:09.970984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d6f1f2c9-bd63-4853-9491-151866d48809 req-f3b90678-9a2f-4e80-aca0-5167067d8651 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:09.984186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-d6f1f2c9-bd63-4853-9491-151866d48809 req-f3b90678-9a2f-4e80-aca0-5167067d8651 service nova] Creating event network-vif-plugged:caa88b03-6ce8-4395-afa3-e6a8043de3f7 for instance 3fc907ee-49c2-4621-b309-f687358b0cb7 on hv-cinder-85200 Sep 12 23:29:09.989189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-d6f1f2c9-bd63-4853-9491-151866d48809 req-f3b90678-9a2f-4e80-aca0-5167067d8651 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037175 Sep 12 23:29:09.989854 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 98/192] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:09.998020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:10.007159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-50c467e1-8a80-46c1-99e1-ab0e1d5d4d8c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.561292 Sep 12 23:29:10.008106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 95/193] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:09 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:10.191285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:10.192029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:10.198080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:10.198574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:10.199013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:10.199735 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:10.200229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:10.201027 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:10.339904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:10.349198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d4d580df-4b3a-405f-ad1e-d24e1ac3e7a0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.162632 Sep 12 23:29:10.349808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 99/194] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:10 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:11.032793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:11.033454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:11.045611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:11.048108 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:11.050989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:11.051755 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:11.054477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:11.054912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:11.213783 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:11.222862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f6ee1a30-0ad1-4d47-9d09-038fbe0e9b59 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.194848 Sep 12 23:29:11.223562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 96/195] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:11 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:11.374158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:11.374800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:11.381138 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:11.384714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:11.384714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:11.384714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:11.384714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:11.385025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:11.577211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:11.586321 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b8dcf78d-07db-444f-8203-334d1063c4ed tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.216085 Sep 12 23:29:11.586973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 100/196] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:11 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:12.245885 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:12.246505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:12.260600 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:12.261307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:12.263992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:12.263992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:12.263992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:12.263992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:12.459279 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:12.469437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9837dd7f-1f87-46de-b828-75c20638d96e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.227468 Sep 12 23:29:12.470216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 97/197] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:12 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:12.611307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:12.611966 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:12.618530 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:12.619040 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:12.619698 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:12.620538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:12.621035 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:12.621492 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:12.768355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:12.776066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c18d2a01-fdb5-44b1-9ffe-f4e489268b02 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1314 microversion: 2.1 time: 0.169148 Sep 12 23:29:12.776629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 101/198] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:12 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:13.492583 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:13.493190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:13.500293 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:13.501022 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:13.501736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:13.502856 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:13.503318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:13.503927 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:13.650084 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:13.658672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5c231b82-0b99-49df-ad21-839c9dfe13f7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.169835 Sep 12 23:29:13.659236 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 98/199] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:13 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:13.800214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:13.800895 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:13.808812 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:13.809514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:13.810145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:13.811385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:13.812549 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:13.813167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:13.999510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:14.010202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6359023a-c482-43f6-9cab-85e2af4a2b25 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1497 microversion: 2.1 time: 0.213959 Sep 12 23:29:14.024590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 102/200] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:13 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:14.520520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:14.521123 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:14.526899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:14.527418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:14.527985 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:14.528533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:14.528994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:14.529456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:14.555155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:29:14.605972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:14.644559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cc874f5b-2312-4857-ad07-11a161e3a06a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 204 len: 0 microversion: 2.1 time: 0.127457 Sep 12 23:29:14.658262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 99/201] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:29:14 2022] DELETE /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:29:14.663546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:14.664178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:14.671367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:14.672203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:14.672892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:14.673849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:14.674439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:14.675091 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:14.682124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:14.682816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:14.690270 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:14.691030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:14.691422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:14.692205 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:14.693400 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:14.693836 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:14.863023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:14.872923 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3f21ddf2-a446-4794-9cb7-151da7f9cc10 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.195102 Sep 12 23:29:14.874951 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 100/202] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:14 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:14.880714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:14.892765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-953f301c-e3b5-4316-90ff-d7442ab8bcf7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1503 microversion: 2.1 time: 0.230899 Sep 12 23:29:14.893759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 103/203] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:14 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:15.900849 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:15.902164 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:15.917196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:15.918205 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:15.918822 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:15.919264 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:15.921376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:15.923735 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:15.924423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:15.926704 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:15.929901 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:15.934616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:15.940353 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:15.942279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:15.943927 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:15.944728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:16.130759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:16.140459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c839469d-fd39-4db0-8fd2-98f3b16149b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.243984 Sep 12 23:29:16.141579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 101/204] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:15 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:16.222087 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:16.230257 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1c898e0f-e228-4f14-bf68-c952130c00c0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1503 microversion: 2.1 time: 0.316647 Sep 12 23:29:16.231069 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 104/205] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:15 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:17.164468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:17.165126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:17.172871 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:17.173820 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:17.174259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:17.175139 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:17.175613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:17.176041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:17.257659 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:17.260040 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:17.269576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:17.270151 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:17.270806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:17.271627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:17.272268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:17.272875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:17.360206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:17.368774 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-900e3e29-4985-4fac-905c-07400e246fcd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.208083 Sep 12 23:29:17.369782 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 102/206] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:17 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:17.464938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:17.486086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2452eae9-9571-49af-9847-da5939f25c66 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1503 microversion: 2.1 time: 0.235455 Sep 12 23:29:17.487197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 105/207] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:17 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:18.395347 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:18.395992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:18.401976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:18.402457 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:18.402917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:18.403592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:18.404060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:18.404484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:18.509446 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:18.510047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:18.517182 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:18.517667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:18.518091 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:18.518776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:18.519533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:18.519699 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:18.537580 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:18.549817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e3360dfe-f512-4b53-9e21-6e2e0d36511b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.158229 Sep 12 23:29:18.550853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 103/208] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:18 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:18.675692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:18.684307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-71308095-15ca-4339-b397-0ef7d561b316 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1503 microversion: 2.1 time: 0.178703 Sep 12 23:29:18.685418 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 106/209] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:18 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:19.575066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:19.576396 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:19.582295 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:19.582769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:19.583221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:19.583920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:19.584364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:19.584775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:19.708526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:19.709558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:19.715521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:19.716036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:19.716471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:19.719535 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:19.723404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:19.723904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:19.724338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:19.728655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-460f67eb-bf97-4496-9f6f-3c6abd959ffa tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.158126 Sep 12 23:29:19.729243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 104/210] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:19 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:19.931548 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:19.949074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-de6c76a5-8459-40f4-bc27-dadc309fd0cb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1503 microversion: 2.1 time: 0.244146 Sep 12 23:29:19.962887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 107/211] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:19 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:20.391118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:20.391663 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:20.398479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.399409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.399875 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.400746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.401350 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.401781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.432619 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:29:20.528971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f4c848b5-2a6e-4748-a4f0-76a923e72ce2 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 204 len: 0 microversion: 2.1 time: 0.142500 Sep 12 23:29:20.529672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 105/212] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:29:20 2022] DELETE /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 23:29:20.551848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:20.559493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:20.577416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.577951 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.578601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.579493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.580417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.581163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.758047 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:20.760363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:20.771145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.772134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.772871 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.775508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.776359 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.777192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.791053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:20.801661 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8355644a-55d5-4bae-83b9-02048f11b84f tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1553 microversion: 2.1 time: 0.265423 Sep 12 23:29:20.802524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 108/213] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:20 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:20.815152 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-6cc6a6c3-41b5-42db-ae7f-b7ed0406ef57 req-8e8b6679-e873-4ed7-a08e-d2a699e3967a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc907ee-49c2-4621-b309-f687358b0cb7", "name": "network-vif-deleted", "tag": "caa88b03-6ce8-4395-afa3-e6a8043de3f7"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:20.828838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6cc6a6c3-41b5-42db-ae7f-b7ed0406ef57 req-8e8b6679-e873-4ed7-a08e-d2a699e3967a service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.829724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6cc6a6c3-41b5-42db-ae7f-b7ed0406ef57 req-8e8b6679-e873-4ed7-a08e-d2a699e3967a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.830376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6cc6a6c3-41b5-42db-ae7f-b7ed0406ef57 req-8e8b6679-e873-4ed7-a08e-d2a699e3967a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.846949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-6cc6a6c3-41b5-42db-ae7f-b7ed0406ef57 req-8e8b6679-e873-4ed7-a08e-d2a699e3967a service nova] Creating event network-vif-deleted:caa88b03-6ce8-4395-afa3-e6a8043de3f7 for instance 3fc907ee-49c2-4621-b309-f687358b0cb7 on hv-cinder-85200 Sep 12 23:29:20.852223 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-6cc6a6c3-41b5-42db-ae7f-b7ed0406ef57 req-8e8b6679-e873-4ed7-a08e-d2a699e3967a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048397 Sep 12 23:29:20.852824 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 109/214] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:20.976733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:20.978095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:20.985968 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.986774 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.987648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:20.988982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:20.989710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:20.990542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:21.046303 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:21.055093 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3f92bd8d-c12f-41b3-8540-231a28d6db4e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.306784 Sep 12 23:29:21.055777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 106/215] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:20 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:21.113894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:21.118115 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:21.124233 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5e75e445-da8f-441a-91d4-be5f2b42a237 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1461 microversion: 2.1 time: 0.154372 Sep 12 23:29:21.127810 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 110/216] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:20 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1461 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:21.829889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:21.832216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:21.838703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:21.839437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:21.840115 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:21.841033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:21.841721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:21.842316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:21.990832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:22.001882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b50e3a5a-ed7a-4dae-afa1-c1a19969d8c3 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1553 microversion: 2.1 time: 0.177579 Sep 12 23:29:22.006731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 107/217] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:21 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:22.080682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:22.081305 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:22.089045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:22.089623 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:22.090090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:22.090847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:22.091343 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:22.091801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:22.151402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:22.152556 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:22.168844 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:22.169386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:22.169811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:22.170560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:22.171200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:22.171638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:22.255239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:22.263804 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-563f26bb-c5eb-4bfd-9231-35ed9794ed60 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.189262 Sep 12 23:29:22.265372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 111/218] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:22 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:22.280761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:22.280761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3f71df8d-36d4-41cd-bc47-061f6df8685b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1299 microversion: 2.1 time: 0.129981 Sep 12 23:29:22.280761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 108/219] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:22 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:23.026028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:23.026666 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:23.036271 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.042269 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.043215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.044187 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.045802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.046430 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.244066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:23.258968 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9f003c0e-477c-451d-a79d-1f2885398878 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1553 microversion: 2.1 time: 0.236601 Sep 12 23:29:23.278063 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 109/220] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:23 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:23.288179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:23.288797 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:23.312298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:23.314150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:23.324347 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.325831 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.326978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.328742 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.329355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.329939 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.336849 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.337767 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.339685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.340742 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.343878 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.344686 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.422458 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.423098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.423677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.424277 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lazy-loading 'fault' on Instance uuid 3fc907ee-49c2-4621-b309-f687358b0cb7 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:23.488052 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:23.499894 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-523fc18d-14ae-42ae-b58a-92d809617030 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 200 len: 1304 microversion: 2.1 time: 0.201069 Sep 12 23:29:23.501907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 110/221] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:23 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:23.557866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-ffaf843d-43fb-4334-b2fb-5e116820a9fd req-370abfa6-a2c5-4648-8131-ca596b84d379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e922a5d-06e3-456e-ac49-64d6c3aba117", "name": "network-vif-deleted", "tag": "262242d2-62b5-4e29-8759-130e6a7786d0"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:23.587471 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ffaf843d-43fb-4334-b2fb-5e116820a9fd req-370abfa6-a2c5-4648-8131-ca596b84d379 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:23.590426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ffaf843d-43fb-4334-b2fb-5e116820a9fd req-370abfa6-a2c5-4648-8131-ca596b84d379 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:23.591648 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ffaf843d-43fb-4334-b2fb-5e116820a9fd req-370abfa6-a2c5-4648-8131-ca596b84d379 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:23.661779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-ffaf843d-43fb-4334-b2fb-5e116820a9fd req-370abfa6-a2c5-4648-8131-ca596b84d379 service nova] Creating event network-vif-deleted:262242d2-62b5-4e29-8759-130e6a7786d0 for instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 on hv-cinder-85200 Sep 12 23:29:23.673536 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-ffaf843d-43fb-4334-b2fb-5e116820a9fd req-370abfa6-a2c5-4648-8131-ca596b84d379 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123590 Sep 12 23:29:23.675272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 111/222] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:23.687154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:23.699882 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7c62b865-815b-4285-aa3c-829116484694 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.415508 Sep 12 23:29:23.701145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 112/223] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:23 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:24.283228 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:24.283991 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:24.291541 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:24.291866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:24.292539 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:24.293305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:24.293943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:24.294333 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:24.330452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:24.331136 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:24.331773 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:24.332220 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lazy-loading 'fault' on Instance uuid 7e922a5d-06e3-456e-ac49-64d6c3aba117 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:24.381054 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98da6780db2d43d5be8e971dd2d86119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811d8512813f49d79facec817fc5d03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:24.392714 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0cd3d2a0-4b27-4ae1-8c1e-9caf3107206e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 200 len: 1351 microversion: 2.1 time: 0.114261 Sep 12 23:29:24.393567 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 112/224] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:24 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:24.525789 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:24.526483 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 3fc907ee-49c2-4621-b309-f687358b0cb7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:24.533709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:24.534296 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:24.534797 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:24.535669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:24.536121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:24.536572 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:24.554331 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] HTTP exception thrown: Instance 3fc907ee-49c2-4621-b309-f687358b0cb7 could not be found. Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Request method failure captured: Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 HTTP/1.1 Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8Cs4hwxCpxGReZWSriFij2CQ81tN7sVqRj0z1h_nJnLaXtUEDOwBJkQK4xyvrYGHraJC5kpYzWtVWBsmM3OaD4V8sQ2ZPXpVSLF9QUzevGyqy2OeZfkBwOGzA9k3WML-zHQXIDS3E7CJDrGQrGgOSZnC5LCGCfysX3nJ57dQIBSP24 Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 641b6882f873400fbef301fc5ce82391 Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesActionsTest-1780566035 Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:29:24.559481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641b6882f873400fbef301fc5ce82391", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641b6882f873400fbef301fc5ce82391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641b6882f873400fbef301fc5ce82391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641b6882f873400fbef301fc5ce82391"}]}] Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesActionsTest-1780566035 Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 641b6882f873400fbef301fc5ce82391 Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesActionsTest-1780566035 Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesActionsTest-1780566035-project Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 2dcd3dd65d5841049ed20e36e847bb53 Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesActionsTest-1780566035-project Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 3fc907ee-49c2-4621-b309-f687358b0cb7 could not be found. Sep 12 23:29:24.561574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '3fc907ee-49c2-4621-b309-f687358b0cb7'} Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc907ee-49c2-4621-b309-f687358b0cb7 could not be found. Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:24.562476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc907ee-49c2-4621-b309-f687358b0cb7 could not be found. Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc907ee-49c2-4621-b309-f687358b0cb7 could not be found. Sep 12 23:29:24.563684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:24.566025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Returning 404 to user: Instance 3fc907ee-49c2-4621-b309-f687358b0cb7 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:24.567033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-78c1a68e-4597-47e8-9a96-c598963441b4 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7" status: 404 len: 111 microversion: 2.1 time: 0.045113 Sep 12 23:29:24.567768 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 113/225] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:24 2022] GET /compute/v2.1/servers/3fc907ee-49c2-4621-b309-f687358b0cb7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:29:24.702365 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-480276919", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "networks": [{"uuid": "b00c67d0-ddbb-4c24-ae7c-fa1370f53f73"}]}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:24.722168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:24.723029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:24.734210 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:24.734802 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:24.736053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:24.738079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:24.739961 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:24.741009 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:24.811173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] validate_networks() for [('b00c67d0-ddbb-4c24-ae7c-fa1370f53f73', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:29:24.933716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:24.944453 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-341cb09d-43c4-4107-b1ea-3926920da536 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.225574 Sep 12 23:29:24.952490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 114/226] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:24 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:25.356906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:29:25.357660 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:29:25.358215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:29:25.358624 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:29:25.359039 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:29:25.367929 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:25.368408 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:25.369016 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:25.369735 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:25.370188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:25.370599 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:25.388578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Getting quotas for project 641b6882f873400fbef301fc5ce82391. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:29:25.393348 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Getting quotas for user 2dcd3dd65d5841049ed20e36e847bb53 and project 641b6882f873400fbef301fc5ce82391. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:29:25.405582 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:29:25.408038 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:29:25.418020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:25.418845 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:25.421510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=73 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:25.427824 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:25.428651 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:25.428992 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:25.429691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:25.430155 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:25.430736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:25.446292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] HTTP exception thrown: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Request method failure captured: Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 HTTP/1.1 Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CTWPag-qHpzkd4QnZyx1hfjlW9tNq5qc_0xIFax-aqNb-g-mR7Ofd4GbgYZRz2xPfjuvUoVYRQCBlUq5RurQPZP9Kp9zPZfc1XZnoRHzIztAXPjIMsHQyfbe2NelWL_09HXqjfQjDDhtWtKBFQX7FZcBNt-vlVDTx8l7yesFuWtIw Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:29:25.448283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_811d8512813f49d79facec817fc5d03e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/811d8512813f49d79facec817fc5d03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}] Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 98da6780db2d43d5be8e971dd2d86119 Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.449507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '7e922a5d-06e3-456e-ac49-64d6c3aba117'} Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:25.450172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.451290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.453039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Returning 404 to user: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:25.453039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d73cc9ad-b26c-483f-b41a-33c38746cb5e tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 404 len: 111 microversion: 2.1 time: 0.036669 Sep 12 23:29:25.453039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 115/227] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:25 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:29:25.480657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2a7ba276-1e51-4e3b-ab2f-9290626cf14a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782560 Sep 12 23:29:25.481401 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 113/228] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:29:25.493157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-21b15b24-cbec-4e59-ad56-1a6464a502d6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:25.493584 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-21b15b24-cbec-4e59-ad56-1a6464a502d6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:25.555909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-21b15b24-cbec-4e59-ad56-1a6464a502d6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:25.564560 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-21b15b24-cbec-4e59-ad56-1a6464a502d6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1213 microversion: 2.1 time: 0.075321 Sep 12 23:29:25.565285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 116/229] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:25 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:25.606165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:25.608448 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:25.615031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:25.615881 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:25.616587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:25.617431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:25.618036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:25.618775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:25.635746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] HTTP exception thrown: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Request method failure captured: Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117/os-volume_attachments HTTP/1.1 Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CTWPag-qHpzkd4QnZyx1hfjlW9tNq5qc_0xIFax-aqNb-g-mR7Ofd4GbgYZRz2xPfjuvUoVYRQCBlUq5RurQPZP9Kp9zPZfc1XZnoRHzIztAXPjIMsHQyfbe2NelWL_09HXqjfQjDDhtWtKBFQX7FZcBNt-vlVDTx8l7yesFuWtIw Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:29:25.643833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_811d8512813f49d79facec817fc5d03e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/811d8512813f49d79facec817fc5d03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}] Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 98da6780db2d43d5be8e971dd2d86119 Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.645504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'server_id': '7e922a5d-06e3-456e-ac49-64d6c3aba117'} Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:25.646459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:25.648150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:25.650860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Returning 404 to user: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:25.652004 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-41cc37f9-9768-4938-8e90-acaef98afb89 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049781 Sep 12 23:29:25.652721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 114/230] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:29:25 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:29:25.974190 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:25.975285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:26.004773 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.005891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.007090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:26.008103 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.008791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.009558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:26.159626 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:26.170119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fb3097b1-feb9-49c2-9cc9-5937f49d77b1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.205311 Sep 12 23:29:26.170878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 117/231] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:25 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:26.446308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-392894447", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:26.503503 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] validate_networks() for None {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:29:26.590826 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:26.591526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:26.599293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.599885 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.600655 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:26.601338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.601791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.602209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:26.674045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:26.682187 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-763b16b2-7144-4058-8bea-8c50b921cc33 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1265 microversion: 2.1 time: 0.096582 Sep 12 23:29:26.682773 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 118/232] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:26 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:26.902026 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:26.902812 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:26.911538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.912219 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.912800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:26.913701 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.914297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.914862 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:26.944648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] HTTP exception thrown: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Request method failure captured: Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 HTTP/1.1 Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CTWPag-qHpzkd4QnZyx1hfjlW9tNq5qc_0xIFax-aqNb-g-mR7Ofd4GbgYZRz2xPfjuvUoVYRQCBlUq5RurQPZP9Kp9zPZfc1XZnoRHzIztAXPjIMsHQyfbe2NelWL_09HXqjfQjDDhtWtKBFQX7FZcBNt-vlVDTx8l7yesFuWtIw Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:29:26.947748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_811d8512813f49d79facec817fc5d03e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/811d8512813f49d79facec817fc5d03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}] Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 98da6780db2d43d5be8e971dd2d86119 Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:26.949086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '7e922a5d-06e3-456e-ac49-64d6c3aba117'} Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:26.949996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:26.963404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:26.966709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Returning 404 to user: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:26.966709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-30ea29ab-20cd-42af-8ad6-344db5a3af04 tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 404 len: 111 microversion: 2.1 time: 0.064481 Sep 12 23:29:26.970151 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 119/233] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:29:26 2022] DELETE /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:29:26.977503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:26.978355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] [instance: 7e922a5d-06e3-456e-ac49-64d6c3aba117] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:26.996485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.996926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.997376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:26.998940 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:26.999448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:26.999923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:27.016437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] HTTP exception thrown: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Request method failure captured: Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 HTTP/1.1 Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CTWPag-qHpzkd4QnZyx1hfjlW9tNq5qc_0xIFax-aqNb-g-mR7Ofd4GbgYZRz2xPfjuvUoVYRQCBlUq5RurQPZP9Kp9zPZfc1XZnoRHzIztAXPjIMsHQyfbe2NelWL_09HXqjfQjDDhtWtKBFQX7FZcBNt-vlVDTx8l7yesFuWtIw Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:29:27.017963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_811d8512813f49d79facec817fc5d03e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/811d8512813f49d79facec817fc5d03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/811d8512813f49d79facec817fc5d03e"}]}] Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 811d8512813f49d79facec817fc5d03e Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-DeleteServersTestJSON-1081951738 Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 98da6780db2d43d5be8e971dd2d86119 Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-DeleteServersTestJSON-1081951738-project Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:27.019512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '7e922a5d-06e3-456e-ac49-64d6c3aba117'} Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:27.020348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. Sep 12 23:29:27.021647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:27.022978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] Returning 404 to user: Instance 7e922a5d-06e3-456e-ac49-64d6c3aba117 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:27.022978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4708cfd8-01bb-4dd6-8f56-2212fdbd043a tempest-DeleteServersTestJSON-1081951738 tempest-DeleteServersTestJSON-1081951738-project] 10.222.0.27 "GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117" status: 404 len: 111 microversion: 2.1 time: 0.047999 Sep 12 23:29:27.022978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 120/234] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:26 2022] GET /compute/v2.1/servers/7e922a5d-06e3-456e-ac49-64d6c3aba117 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:29:27.033959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:29:27.034676 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:29:27.036105 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:29:27.036673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:29:27.037204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:29:27.046937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:27.047602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:27.048207 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:27.048925 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:27.049374 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:27.049789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:27.083897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Getting quotas for project 6fa4238c07c0476095fde3edb52432ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:29:27.088169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Getting quotas for user ec0a2c1fdc7945f6ac260c8e8ae7ad4d and project 6fa4238c07c0476095fde3edb52432ef. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:29:27.101575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:29:27.103995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:29:27.118746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:27.158873 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ae0a4350-453e-48f7-b560-ec32806e9306 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716496 Sep 12 23:29:27.159500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 115/235] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:29:27.171245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a29b2720-93c1-4c6c-b7eb-16bea14ab255 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:27.171910 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a29b2720-93c1-4c6c-b7eb-16bea14ab255 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:27.203222 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:27.204156 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:27.211479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:27.211901 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:27.212377 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:27.213076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:27.213557 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:27.214155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:27.236448 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:27.351942 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a29b2720-93c1-4c6c-b7eb-16bea14ab255 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:27.359465 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a29b2720-93c1-4c6c-b7eb-16bea14ab255 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1214 microversion: 2.1 time: 0.192675 Sep 12 23:29:27.360072 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 121/236] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:27 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:27.414616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:27.429776 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5d3b147e-3d23-4d1c-8479-e5265f196114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.230470 Sep 12 23:29:27.430398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 116/237] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:27 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:27.706616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:27.707999 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:27.721426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:27.724611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:27.725415 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:27.727849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:27.728578 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:27.730013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:27.843959 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:27.854987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-73c73eb0-759a-42dc-9120-e03ecc4c257b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1271 microversion: 2.1 time: 0.152192 Sep 12 23:29:27.855866 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 122/238] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:27 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:28.384110 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:28.384623 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:28.391119 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:28.391610 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:28.392046 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:28.392724 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:28.393177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:28.393595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:28.456051 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:28.457044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:28.457652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:28.465645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:28.466482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:28.467686 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:28.467811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ee54bf0d-7911-4798-921a-945ce71d994a tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1266 microversion: 2.1 time: 0.085942 Sep 12 23:29:28.468648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:28.469021 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 117/239] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:28 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:28.469683 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:28.470643 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:28.808065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:28.826038 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9de545bb-9983-415f-ae73-b50d4972cbd2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.373416 Sep 12 23:29:28.827051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 123/240] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:28 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:28.884006 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:28.884634 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:28.892040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:28.892575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:28.893649 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:28.894360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:28.894972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:28.895551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:29.102658 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:29.111711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0251039b-9556-4af3-8b58-ed24ce7a26d8 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.232322 Sep 12 23:29:29.112587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 118/241] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:28 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:29.491291 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:29.491948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:29.505319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:29.505823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:29.506261 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:29.508943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:29.509690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:29.510367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:29.601997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:29.611251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-21c8fe7f-f992-49f6-801b-fd3b505f5025 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1272 microversion: 2.1 time: 0.123791 Sep 12 23:29:29.624222 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 124/242] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:29 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:29.850145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:29.851530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:29.864242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:29.865635 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:29.866401 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:29.867545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:29.868173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:29.868736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:30.026179 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:30.037575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1f1cd93b-68e6-4f4b-aaed-3922b36fe594 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.191181 Sep 12 23:29:30.039195 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 119/243] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:29 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:30.134761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:30.135694 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:30.144042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:30.144779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:30.145319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:30.146084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:30.146618 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:30.147102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:30.546252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:30.555671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bd41e46e-bd04-44cc-a41e-a712da82b6eb tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.424942 Sep 12 23:29:30.556491 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 125/244] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:30 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:30.576862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-42289349-b400-4baf-a19b-c1def8f31704 req-fbb93b8b-20e9-48b3-a3ef-07877dc747bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e47a7d-ea1f-4363-b801-a76ce8db7f23", "tag": "9affba5c-e561-4b66-b889-1c5a4ca0fa50"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:30.586768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-42289349-b400-4baf-a19b-c1def8f31704 req-fbb93b8b-20e9-48b3-a3ef-07877dc747bc service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:30.587403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-42289349-b400-4baf-a19b-c1def8f31704 req-fbb93b8b-20e9-48b3-a3ef-07877dc747bc service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:30.588040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-42289349-b400-4baf-a19b-c1def8f31704 req-fbb93b8b-20e9-48b3-a3ef-07877dc747bc service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:30.600147 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-42289349-b400-4baf-a19b-c1def8f31704 req-fbb93b8b-20e9-48b3-a3ef-07877dc747bc service nova] Creating event network-changed:9affba5c-e561-4b66-b889-1c5a4ca0fa50 for instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 on hv-cinder-85200 Sep 12 23:29:30.606004 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-42289349-b400-4baf-a19b-c1def8f31704 req-fbb93b8b-20e9-48b3-a3ef-07877dc747bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032749 Sep 12 23:29:30.607229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 120/245] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:30.636444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:30.637270 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:30.646838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:30.649858 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:30.650416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:30.651173 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:30.653265 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:30.653700 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:30.801798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:30.809821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2f017654-47c0-482d-9e0a-02e417369bff tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.177565 Sep 12 23:29:30.811246 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 126/246] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:30 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:31.063344 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:31.064636 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:31.072046 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:31.072526 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:31.073147 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:31.073846 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:31.074500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:31.074920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:31.409701 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:31.422060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c3c60e8c-66b5-4c54-a8b9-901591f22972 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.363334 Sep 12 23:29:31.422771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 121/247] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:31 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:31.580206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:31.586070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:31.589613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:31.590118 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:31.590549 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:31.591231 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:31.591724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:31.592142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:31.790896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:31.800132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-19efad90-6919-4be9-a4e3-ff5a27fa993a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.224773 Sep 12 23:29:31.800697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 127/248] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:31 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:31.833490 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:31.834094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:31.840103 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:31.840654 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:31.841304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:31.842589 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:31.843120 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:31.843631 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:32.009094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:32.017512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-02dddc1c-3141-4bd0-95cb-855d904c1ed0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.188016 Sep 12 23:29:32.037493 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 122/249] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:31 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:32.445232 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:32.446096 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:32.456653 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:32.457337 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:32.457774 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:32.458478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:32.458937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:32.459363 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:32.633904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:32.642964 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-72cf673e-c444-4300-b925-dbee1821e4e7 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.201508 Sep 12 23:29:32.643759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 128/250] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:32 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:32.825518 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:32.828720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:32.835092 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:32.835697 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:32.836357 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:32.837310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:32.838229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:32.838716 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:33.047248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:33.048993 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:33.077963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:33.080457 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:33.081072 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:33.082088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:33.082711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:33.083329 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:33.159372 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:33.173729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ea8bf4d1-d9da-4168-b4e4-2ca0a19498ab tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.353576 Sep 12 23:29:33.174563 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 123/251] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:32 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:33.400612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:33.414650 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-209018b4-2f9a-461f-9d18-9ae0290ce07b tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.373142 Sep 12 23:29:33.415507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 129/252] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:33 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:33.668059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:33.668667 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:33.679231 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:33.679901 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:33.682472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:33.688531 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:33.689025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:33.689478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:33.939192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-719c0361-e4e2-4dce-baf4-915061d973e2 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Action: 'create', calling method: .version_select at 0x7fa4b39864c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1579818777", "metadata": {"Type": "work"}}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:33.943198 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:33.952556 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-eeacefc9-ab9b-4b91-8783-b1ece0f2a040 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.288529 Sep 12 23:29:33.956200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 124/253] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:33 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-719c0361-e4e2-4dce-baf4-915061d973e2 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Request method failure captured: Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 122 Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8Dd5HCRR8Oji2vOn1oD7g6Ivcx4OTbpEJ-rSjR_Uikxc_OV34uSIZc1kdJV2rwm7eQKj42DYdhNsQ0lBmmmPGxLAH4EKExwSjqaK6YoZVUViINOQzpMCIyo0-XriYGeKOIpnL4x_cj06I7Zc_pwssQtjTwaiE-DYsmv3aP9r55FON0 Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:29:33.974558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fb450976bcd4590bf2457e1d6fbbd10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}] Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: c626ba7e4b954484ad8bdf23ce5fe87b Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1579818777", "metadata": {"Type": "work"}}} Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: Sep 12 23:29:33.976127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1579818777', 'metadata': {'Type': 'work'}}}} Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise error Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi '#$%' Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:33.977033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 23:29:33.978494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 23:29:33.979822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 23:29:33.979822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.979822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-719c0361-e4e2-4dce-baf4-915061d973e2 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:33.979822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-719c0361-e4e2-4dce-baf4-915061d973e2 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.194162 Sep 12 23:29:33.983843 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 130/254] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Sep 12 23:29:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:29:33.989508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4003a64c-ebef-4b35-a7cb-04431cca40da tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Action: 'create', calling method: .version_select at 0x7fa4b38dab80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-874042071", "metadata": {"Type": "work"}}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4003a64c-ebef-4b35-a7cb-04431cca40da tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Request method failure captured: Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 119 Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8Dd5HCRR8Oji2vOn1oD7g6Ivcx4OTbpEJ-rSjR_Uikxc_OV34uSIZc1kdJV2rwm7eQKj42DYdhNsQ0lBmmmPGxLAH4EKExwSjqaK6YoZVUViINOQzpMCIyo0-XriYGeKOIpnL4x_cj06I7Zc_pwssQtjTwaiE-DYsmv3aP9r55FON0 Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:29:33.994502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fb450976bcd4590bf2457e1d6fbbd10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}] Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: c626ba7e4b954484ad8bdf23ce5fe87b Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-874042071", "metadata": {"Type": "work"}}} Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: Sep 12 23:29:33.996144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-874042071', 'metadata': {'Type': 'work'}}}} Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise error Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi '0' Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:33.996952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 23:29:33.999413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 23:29:34.001867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 23:29:34.001867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.001867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4003a64c-ebef-4b35-a7cb-04431cca40da tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:34.001867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4003a64c-ebef-4b35-a7cb-04431cca40da tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010859 Sep 12 23:29:34.007974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 125/255] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Sep 12 23:29:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:29:34.010541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-76c764a3-7e4e-43b9-b560-d77f5da09f02 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Action: 'create', calling method: .version_select at 0x7fa4b3a20160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-968497141", "metadata": {"Type": "work"}}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-76c764a3-7e4e-43b9-b560-d77f5da09f02 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Request method failure captured: Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 118 Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8Dd5HCRR8Oji2vOn1oD7g6Ivcx4OTbpEJ-rSjR_Uikxc_OV34uSIZc1kdJV2rwm7eQKj42DYdhNsQ0lBmmmPGxLAH4EKExwSjqaK6YoZVUViINOQzpMCIyo0-XriYGeKOIpnL4x_cj06I7Zc_pwssQtjTwaiE-DYsmv3aP9r55FON0 Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:29:34.025197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fb450976bcd4590bf2457e1d6fbbd10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}] Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: c626ba7e4b954484ad8bdf23ce5fe87b Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-968497141", "metadata": {"Type": "work"}}} Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: Sep 12 23:29:34.026469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-968497141', 'metadata': {'Type': 'work'}}}} Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise error Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi '' Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:34.027197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 23:29:34.028496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 23:29:34.030475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 23:29:34.030475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.031979 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-76c764a3-7e4e-43b9-b560-d77f5da09f02 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:34.032870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-76c764a3-7e4e-43b9-b560-d77f5da09f02 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028476 Sep 12 23:29:34.035938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 131/256] 10.222.0.27 () {60 vars in 1156 bytes} [Mon Sep 12 23:29:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:29:34.044055 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-96d76e86-269f-41eb-be9b-fac260f24595 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Calling method '.version_select at 0x7fa4b3bfbaf0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:34.055510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-690033ca-2a33-4df8-a86d-872a72ae64f8 req-e5b830c8-11a3-4110-a2cc-185358b7e84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13bcc690-65ac-4aea-adf2-3a8337a3d83e", "tag": "f2e1908c-7aa5-4fac-b276-d75bf334f55c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:34.067239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-690033ca-2a33-4df8-a86d-872a72ae64f8 req-e5b830c8-11a3-4110-a2cc-185358b7e84c service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:34.068095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-690033ca-2a33-4df8-a86d-872a72ae64f8 req-e5b830c8-11a3-4110-a2cc-185358b7e84c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:34.068705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-690033ca-2a33-4df8-a86d-872a72ae64f8 req-e5b830c8-11a3-4110-a2cc-185358b7e84c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:34.083142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-690033ca-2a33-4df8-a86d-872a72ae64f8 req-e5b830c8-11a3-4110-a2cc-185358b7e84c service nova] Creating event network-changed:f2e1908c-7aa5-4fac-b276-d75bf334f55c for instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e on hv-cinder-85200 Sep 12 23:29:34.088826 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-690033ca-2a33-4df8-a86d-872a72ae64f8 req-e5b830c8-11a3-4110-a2cc-185358b7e84c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039708 Sep 12 23:29:34.090169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 132/257] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:34.099976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-96d76e86-269f-41eb-be9b-fac260f24595 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] HTTP exception thrown: Volume tempest-invalid-941630313 could not be found. Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-96d76e86-269f-41eb-be9b-fac260f24595 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Request method failure captured: Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-941630313 HTTP/1.1 Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8Dd5HCRR8Oji2vOn1oD7g6Ivcx4OTbpEJ-rSjR_Uikxc_OV34uSIZc1kdJV2rwm7eQKj42DYdhNsQ0lBmmmPGxLAH4EKExwSjqaK6YoZVUViINOQzpMCIyo0-XriYGeKOIpnL4x_cj06I7Zc_pwssQtjTwaiE-DYsmv3aP9r55FON0 Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:29:34.101917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fb450976bcd4590bf2457e1d6fbbd10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}] Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: c626ba7e4b954484ad8bdf23ce5fe87b Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Volume tempest-invalid-941630313 could not be found. Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'tempest-invalid-941630313'} Sep 12 23:29:34.103465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-941630313 could not be found. (HTTP 404) (Request-ID: req-3a7f5aaf-1a1c-476d-a0c3-b67e8a817b2e) Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.104456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:29:34.105784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-941630313 could not be found. Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:34.107033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-941630313 could not be found. Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-941630313 could not be found. Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-96d76e86-269f-41eb-be9b-fac260f24595 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Returning 404 to user: Volume tempest-invalid-941630313 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-96d76e86-269f-41eb-be9b-fac260f24595 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-941630313" status: 404 len: 98 microversion: 2.1 time: 0.064532 Sep 12 23:29:34.109869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 126/258] 10.222.0.27 () {58 vars in 1215 bytes} [Mon Sep 12 23:29:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-941630313 => generated 98 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 12 23:29:34.118188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9ff3f2f1-8127-485e-b0da-747eb3887df7 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004508 Sep 12 23:29:34.118696 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 133/259] 10.222.0.27 () {58 vars in 1140 bytes} [Mon Sep 12 23:29:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 12 23:29:34.127905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6480dbbc-f27a-41d8-b31b-d3eebc0eff3c tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004084 Sep 12 23:29:34.128398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 127/260] 10.222.0.27 () {58 vars in 1137 bytes} [Mon Sep 12 23:29:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 12 23:29:34.137319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5693fcfc-4d1d-4469-8912-8ed77507dc59 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Calling method '.version_select at 0x7fa4b4609e50>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:34.167365 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-5693fcfc-4d1d-4469-8912-8ed77507dc59 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] HTTP exception thrown: Volume e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 could not be found. Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5693fcfc-4d1d-4469-8912-8ed77507dc59 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Request method failure captured: Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/os-volumes/e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 HTTP/1.1 Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8Dd5HCRR8Oji2vOn1oD7g6Ivcx4OTbpEJ-rSjR_Uikxc_OV34uSIZc1kdJV2rwm7eQKj42DYdhNsQ0lBmmmPGxLAH4EKExwSjqaK6YoZVUViINOQzpMCIyo0-XriYGeKOIpnL4x_cj06I7Zc_pwssQtjTwaiE-DYsmv3aP9r55FON0 Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:29:34.169443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fb450976bcd4590bf2457e1d6fbbd10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}] Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: c626ba7e4b954484ad8bdf23ce5fe87b Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Volume e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 could not be found. Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'e1a76eae-0e1a-46fa-8790-fcab4b0e7c56'} Sep 12 23:29:34.171502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 could not be found. (HTTP 404) (Request-ID: req-ab9612d3-cd77-4d59-a7fe-48e453707998) Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.172554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:29:34.173575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 could not be found. Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 23:29:34.174589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 could not be found. Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 could not be found. Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5693fcfc-4d1d-4469-8912-8ed77507dc59 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Returning 404 to user: Volume e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5693fcfc-4d1d-4469-8912-8ed77507dc59 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/e1a76eae-0e1a-46fa-8790-fcab4b0e7c56" status: 404 len: 109 microversion: 2.1 time: 0.038231 Sep 12 23:29:34.175938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 134/261] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:29:34 2022] DELETE /compute/v2.1/os-volumes/e1a76eae-0e1a-46fa-8790-fcab4b0e7c56 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:29:34.182126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6522670b-2a58-4d4f-b01c-adcbecdf08c4 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Calling method '.version_select at 0x7fa4b38daca0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:34.196222 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:34.196943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:34.205062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:34.205540 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:34.206136 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:34.206987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:34.207621 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:34.208181 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:34.215447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-6522670b-2a58-4d4f-b01c-adcbecdf08c4 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] HTTP exception thrown: Volume ca25b757-da79-47a7-9a54-9a814e1c11d4 could not be found. Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6522670b-2a58-4d4f-b01c-adcbecdf08c4 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Request method failure captured: Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/os-volumes/ca25b757-da79-47a7-9a54-9a814e1c11d4 HTTP/1.1 Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8Dd5HCRR8Oji2vOn1oD7g6Ivcx4OTbpEJ-rSjR_Uikxc_OV34uSIZc1kdJV2rwm7eQKj42DYdhNsQ0lBmmmPGxLAH4EKExwSjqaK6YoZVUViINOQzpMCIyo0-XriYGeKOIpnL4x_cj06I7Zc_pwssQtjTwaiE-DYsmv3aP9r55FON0 Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:29:34.218709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fb450976bcd4590bf2457e1d6fbbd10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fb450976bcd4590bf2457e1d6fbbd10"}]}] Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 3fb450976bcd4590bf2457e1d6fbbd10 Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesNegativeTest-208506929 Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: c626ba7e4b954484ad8bdf23ce5fe87b Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesNegativeTest-208506929-project Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Volume ca25b757-da79-47a7-9a54-9a814e1c11d4 could not be found. Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'ca25b757-da79-47a7-9a54-9a814e1c11d4'} Sep 12 23:29:34.220423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca25b757-da79-47a7-9a54-9a814e1c11d4 could not be found. (HTTP 404) (Request-ID: req-38ae2795-9ac7-480f-9261-adf79d6eaa8a) Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.221647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:29:34.222880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca25b757-da79-47a7-9a54-9a814e1c11d4 could not be found. Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 23:29:34.224886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca25b757-da79-47a7-9a54-9a814e1c11d4 could not be found. Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca25b757-da79-47a7-9a54-9a814e1c11d4 could not be found. Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:29:34.226267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6522670b-2a58-4d4f-b01c-adcbecdf08c4 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] Returning 404 to user: Volume ca25b757-da79-47a7-9a54-9a814e1c11d4 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:29:34.228061 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6522670b-2a58-4d4f-b01c-adcbecdf08c4 tempest-VolumesNegativeTest-208506929 tempest-VolumesNegativeTest-208506929-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca25b757-da79-47a7-9a54-9a814e1c11d4" status: 404 len: 109 microversion: 2.1 time: 0.048120 Sep 12 23:29:34.228061 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 128/262] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:29:34 2022] GET /compute/v2.1/os-volumes/ca25b757-da79-47a7-9a54-9a814e1c11d4 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:29:34.366080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:34.374280 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5db45c1a-68b8-4886-a68b-991ca6034ab6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.181861 Sep 12 23:29:34.374862 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 135/263] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:34 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:34.443003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:34.444441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:34.450257 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:34.451435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:34.452295 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:34.453227 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:34.453952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:34.454498 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:34.604003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:34.612233 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b69ead8a-0b08-47fb-aea5-45d73eed1724 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.172869 Sep 12 23:29:34.612803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 129/264] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:34 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:34.981380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:34.984066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:34.990368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:34.990889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:34.991346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:34.992063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:34.992816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:34.993701 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:35.135106 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:35.140925 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:35.148000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e60e5a19-7e72-4b55-b0fe-ec348e8b18a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.171417 Sep 12 23:29:35.148761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 136/265] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:34 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:35.397456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:35.398560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:35.410496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:35.411252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:35.412918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:35.414115 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:35.414749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:35.415360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:35.626999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:35.634759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:35.635751 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:35.636523 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bb5c3888-e05a-427d-9f70-267046b204d5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.243036 Sep 12 23:29:35.637264 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 130/266] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:35 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:35.662142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:35.662675 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:35.663115 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:35.663946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:35.664631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:35.665333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:35.817014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:35.825673 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aa7b8805-cb13-4a77-ae7f-7c0aabf763b6 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.195089 Sep 12 23:29:35.826631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 137/267] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:35 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:36.172415 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:36.173140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:36.178891 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:36.179374 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:36.179849 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:36.180526 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:36.180966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:36.181375 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:36.312690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:36.320322 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-38aa2864-20f4-4f1c-9920-5c57d7524c53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.152187 Sep 12 23:29:36.324786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 131/268] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:36 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:36.664622 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:36.665279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:36.671790 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:36.672279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:36.672715 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:36.673397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:36.673847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:36.674443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:36.835220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:36.845570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-43416930-2547-4b95-832c-15a9ddd8b729 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.184726 Sep 12 23:29:36.846275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 138/269] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:36 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:36.852160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:36.853191 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:36.861638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:36.862569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:36.863163 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:36.864021 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:36.864835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:36.865520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:37.017652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:37.025989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-61ba45f5-4be5-40e1-a0a8-d2631335628d tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.178210 Sep 12 23:29:37.026928 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 132/270] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:36 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:37.347374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:37.348237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:37.359060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:37.360948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:37.361284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:37.361745 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:37.363105 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:37.363589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:37.364033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:37.520916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:37.528593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-446203ad-31ae-4eaf-b09f-78aaaa2bb56c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.186886 Sep 12 23:29:37.529195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 139/271] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:37 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:37.870306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:37.871776 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:37.879070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=4 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:37.880099 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=12 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:37.882914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:37.883799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:37.883799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:37.884828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:37.885284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:37.885705 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:38.040526 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:38.051299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-87273eb1-0d2f-4e12-8236-00dd029f9143 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.184713 Sep 12 23:29:38.051960 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 133/272] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:37 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:38.052222 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:38.053547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:38.061647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:38.062664 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:38.063448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:38.064362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:38.065132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:38.065574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:38.226283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:38.234166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bfd69ce0-d0b1-4c9a-abb0-f02a65f056d9 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.186924 Sep 12 23:29:38.234709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 140/273] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:38 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:38.552685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:38.553266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:38.559138 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:38.559650 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:38.560578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:38.561267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:38.561714 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:38.562132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:38.699177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:38.707592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f4e55703-2f68-4418-ba01-b088c6be22bb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.158697 Sep 12 23:29:38.710782 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 134/274] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:38 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:39.078922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:39.080390 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:39.091724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:39.092542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:39.094142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:39.095440 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:39.096060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:39.097058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:39.161140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-d92191c9-27dd-4dd3-aa04-46c051ae4dbb req-9b8b589d-97b5-47d5-a114-0d7caeeb51da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e47a7d-ea1f-4363-b801-a76ce8db7f23", "name": "network-vif-plugged", "status": "completed", "tag": "9affba5c-e561-4b66-b889-1c5a4ca0fa50"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:39.182843 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-d92191c9-27dd-4dd3-aa04-46c051ae4dbb req-9b8b589d-97b5-47d5-a114-0d7caeeb51da service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:39.183323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-d92191c9-27dd-4dd3-aa04-46c051ae4dbb req-9b8b589d-97b5-47d5-a114-0d7caeeb51da service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:39.183943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-d92191c9-27dd-4dd3-aa04-46c051ae4dbb req-9b8b589d-97b5-47d5-a114-0d7caeeb51da service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:39.202989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-d92191c9-27dd-4dd3-aa04-46c051ae4dbb req-9b8b589d-97b5-47d5-a114-0d7caeeb51da service nova] Creating event network-vif-plugged:9affba5c-e561-4b66-b889-1c5a4ca0fa50 for instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 on hv-cinder-85200 Sep 12 23:29:39.215647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-d92191c9-27dd-4dd3-aa04-46c051ae4dbb req-9b8b589d-97b5-47d5-a114-0d7caeeb51da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058698 Sep 12 23:29:39.218839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 135/275] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:29:39.257700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:39.258641 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:39.270159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:39.272779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:39.273932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:39.278486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:39.279157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:39.280048 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:39.340722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:39.357816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-70aaa854-bb69-45f2-a9fb-47c149ce1099 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.285258 Sep 12 23:29:39.362176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 141/276] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:39 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:39.640634 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:39.650932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-068c4509-92b7-4f5f-8262-1dd7813d99ae tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.397205 Sep 12 23:29:39.651799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 136/277] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:39 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:39.730090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:39.730693 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:39.737018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:39.737498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:39.737952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:39.738629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:39.739080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:39.739503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:39.873330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:39.881200 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-143fa517-4811-4351-b12a-85a9f1bc3fb9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.154943 Sep 12 23:29:39.881921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 142/278] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:39 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:40.385127 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:40.385742 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:40.392188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:40.392678 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:40.393113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:40.393803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:40.394261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:40.394716 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:40.532891 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:40.542266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-474b75be-c2db-440f-b882-f1106d65cab5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.160818 Sep 12 23:29:40.542919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 137/279] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:40 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:40.678894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:40.680420 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:40.688720 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:40.689240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:40.689533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:40.690232 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:40.690686 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:40.691128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:40.844411 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:40.854176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5a8ab119-e054-453d-b605-67657deb0f61 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.180338 Sep 12 23:29:40.855088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 143/280] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:40 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:40.903772 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:40.904579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:40.911133 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:40.911837 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:40.912595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:40.913452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:40.914039 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:40.914827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:40.939463 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:41.137597 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:41.150609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-818c8a5e-3622-496b-962d-ead63209d2eb tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.250594 Sep 12 23:29:41.151385 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 138/281] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:40 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:41.234000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-59453a7e-2fe0-422d-b1d5-4c3e3154b3b0 req-df144e9f-492f-464d-ac7f-df7ffb1f0b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bcc690-65ac-4aea-adf2-3a8337a3d83e", "name": "network-vif-plugged", "status": "completed", "tag": "f2e1908c-7aa5-4fac-b276-d75bf334f55c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:41.243856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-59453a7e-2fe0-422d-b1d5-4c3e3154b3b0 req-df144e9f-492f-464d-ac7f-df7ffb1f0b43 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:41.244330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-59453a7e-2fe0-422d-b1d5-4c3e3154b3b0 req-df144e9f-492f-464d-ac7f-df7ffb1f0b43 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:41.244754 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-59453a7e-2fe0-422d-b1d5-4c3e3154b3b0 req-df144e9f-492f-464d-ac7f-df7ffb1f0b43 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:41.256551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-59453a7e-2fe0-422d-b1d5-4c3e3154b3b0 req-df144e9f-492f-464d-ac7f-df7ffb1f0b43 service nova] Creating event network-vif-plugged:f2e1908c-7aa5-4fac-b276-d75bf334f55c for instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e on hv-cinder-85200 Sep 12 23:29:41.262625 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-59453a7e-2fe0-422d-b1d5-4c3e3154b3b0 req-df144e9f-492f-464d-ac7f-df7ffb1f0b43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 Sep 12 23:29:41.263242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 144/282] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:29:41.566403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:41.567552 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:41.573604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:41.574082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:41.574504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:41.575442 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:41.575963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:41.576378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:41.721905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:41.729752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c8e9611a-af8d-4f5f-8465-1e7f1cc9607c tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1313 microversion: 2.1 time: 0.167806 Sep 12 23:29:41.730313 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 139/283] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:41 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:41.879393 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:41.880620 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:41.888018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:41.888706 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:41.889144 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:41.890581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:41.891989 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:41.892439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:42.049193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:42.057600 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-74d89bc7-23a1-4280-8b49-d5a9ae0b0192 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.183077 Sep 12 23:29:42.058635 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 145/284] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:41 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:42.174445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:42.175283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:42.181376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:42.182285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:42.182865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:42.183740 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:42.184349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:42.184765 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:42.324453 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:42.332252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-401a9025-eb73-47ff-9fda-6579d25d424c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.161532 Sep 12 23:29:42.332842 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 140/285] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:42 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:42.753083 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:42.753692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:42.759507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:42.760050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:42.760483 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:42.761161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:42.761609 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:42.762028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:42.889969 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:42.897667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b573b932-6485-4082-a028-ddb9a62f27dd tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1496 microversion: 2.1 time: 0.148447 Sep 12 23:29:42.898349 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 146/286] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:42 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1496 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:43.081485 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:43.082094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:43.088830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:43.089381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:43.089853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:43.090584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:43.091081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:43.091549 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:43.229832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:43.239864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-fceb3c1d-17f2-4ba2-967d-ab92d2c85416 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.162276 Sep 12 23:29:43.240439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 141/287] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:43 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:43.355626 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:43.356230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:43.362788 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:43.363268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:43.363728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:43.364409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:43.364947 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:43.365362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:43.494144 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:43.501745 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0a785f58-c195-4ebb-8ced-9a430b9b4d28 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.150006 Sep 12 23:29:43.502326 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 147/288] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:43 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:44.262013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:44.262611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:44.269050 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:44.269560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:44.269989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:44.270668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:44.271114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:44.271528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:44.400208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:44.408686 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d818e033-fe14-468f-83f6-c26839bee9e4 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.150470 Sep 12 23:29:44.409243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 142/289] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:44 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:44.524770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:44.525300 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:44.532574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:44.533057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:44.533485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:44.534161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:44.534604 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:44.535023 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:44.664446 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:44.672486 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e7b27a16-20c4-452c-b388-10db710222f8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.151512 Sep 12 23:29:44.673005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 148/290] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:44 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:45.430789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:45.431385 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:45.437758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:45.438232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:45.438658 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:45.439332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:45.439805 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:45.440221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:45.568672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:45.576797 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1a5c7456-85f6-438a-83a1-766d1264b4ec tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.149798 Sep 12 23:29:45.577353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 143/291] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:45 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:45.694848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:45.695458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:45.701900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:45.702384 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:45.702837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:45.703497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:45.703974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:45.704395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:45.830231 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:45.837751 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4698051c-186c-4b45-a6de-0f52806e0a20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.146743 Sep 12 23:29:45.838303 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 149/292] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:45 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:46.192423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:46.192918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:46.198802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.199280 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.199754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.200447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.200885 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.201304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.225507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:29:46.298720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5cd81eba-4358-4257-9972-fafd660fde68 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "DELETE /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 204 len: 0 microversion: 2.1 time: 0.109766 Sep 12 23:29:46.299469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 144/293] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:29:46 2022] DELETE /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:29:46.307319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:46.307961 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:46.313743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.314224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.314654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.315331 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.315842 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.316291 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.448058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:46.456343 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-181b2021-68f0-4064-9b18-ed741daa9706 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.152943 Sep 12 23:29:46.456905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 150/294] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:46 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:46.604673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:46.605607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:46.611826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.612312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.612741 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.613455 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.614160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.614779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.751115 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:46.758656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7e4742d8-4c2f-4147-850e-873a785db9f7 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.158338 Sep 12 23:29:46.759221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 145/295] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:46 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:46.860770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:46.861307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:46.867451 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.867956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.868386 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.869054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:46.869499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:46.869916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:46.995915 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:47.003882 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9a73ede8-0e6f-4f64-acb0-b3a53ab83031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.146977 Sep 12 23:29:47.004432 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 151/296] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:46 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:47.480287 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:47.480893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:47.486816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:47.487292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:47.487754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:47.488436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:47.488893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:47.489309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:47.619224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:47.627321 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ad346328-d90d-44b1-8b39-735221e91b71 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.150937 Sep 12 23:29:47.627924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 146/297] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:47 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:47.781455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:47.782062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:47.788029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:47.788505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:47.788933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:47.789638 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:47.790081 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:47.790500 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:47.916025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:47.926454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b70b4ede-cf51-4b48-939b-a2e52faa56df tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.149010 Sep 12 23:29:47.926849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 152/298] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:47 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:48.026078 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:48.026614 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:48.033068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:48.033581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:48.034015 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:48.034728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:48.035176 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:48.035683 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:48.160401 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:48.168065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9ce5a551-34ae-4321-be33-84b9cef70961 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.145814 Sep 12 23:29:48.168624 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 147/299] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:48 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:48.651593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:48.652229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:48.658886 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:48.659365 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:48.659830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:48.660505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:48.660959 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:48.661380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:48.791793 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:48.803369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-33752658-3fe4-4143-8e8b-a9d9ce7aac73 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.156337 Sep 12 23:29:48.804312 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 153/300] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:48 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:48.948173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:48.948790 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:48.955435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:48.956019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:48.956539 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:48.957289 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:48.957835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:48.958316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:49.086675 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:49.094191 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c1810702-75ae-40ba-9167-0f796dc810c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1314 microversion: 2.1 time: 0.149878 Sep 12 23:29:49.094747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 148/301] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:48 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:49.191691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:49.192304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:49.199057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:49.199544 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:49.200011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:49.201325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:49.201784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:49.202209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:49.206153 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:49.331319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:49.339387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d000b0a1-5059-4d4e-8264-6f92e06368f2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.151551 Sep 12 23:29:49.340019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 154/302] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:49 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:49.601685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:49.602093 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:49.608494 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:49.608974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:49.609409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:49.610089 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:49.610538 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:49.610957 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:49.633788 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5913f7e3-f2cf-4e1e-ba6e-bba6fc030fc6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/ips" status: 200 len: 152 microversion: 2.20 time: 0.036134 Sep 12 23:29:49.634330 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 149/303] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Sep 12 23:29:49 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:29:49.836515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:49.837134 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:49.844448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:49.845179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:49.845720 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:49.846683 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:49.847956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:49.848390 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.030899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:50.038903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-81b266c3-a203-4cea-ae1d-7e0e6cf7198b tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.209097 Sep 12 23:29:50.039459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 155/304] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:49 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:50.117569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:50.118244 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:50.125998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.127195 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.127835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.129236 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.130256 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.130927 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.275905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:50.283829 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-477af036-cfb1-4444-a39f-72c4aa35b688 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1463 microversion: 2.1 time: 0.170068 Sep 12 23:29:50.284391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 150/305] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:50 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:50.332893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:50.333681 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:50.340150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.340671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.341260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.342149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.342601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.343224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.363299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:50.363945 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:50.369688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:29:50.369814 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.370278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.370705 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.371385 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.371884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.372953 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.462213 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3ba5db20-024a-44eb-a028-5266a43663c1 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "DELETE /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 204 len: 0 microversion: 2.1 time: 0.133852 Sep 12 23:29:50.462791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 156/306] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:29:50 2022] DELETE /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:29:50.471594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:50.472565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:50.478447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.478937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.479375 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.480087 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:50.480576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:50.480996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:50.506639 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:50.514665 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-eb578af3-3ac7-4170-b85b-b4afd3fa3732 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.155228 Sep 12 23:29:50.515353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 151/307] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:50 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:50.608941 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:50.616425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c7f685a7-dc60-42d9-8f90-9b152517a93c tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1469 microversion: 2.1 time: 0.149212 Sep 12 23:29:50.616976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 157/308] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:50 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:51.063853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:51.065123 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:51.071390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.071909 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.072346 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.073031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.073484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.073906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.218479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:51.226937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ce4b7f23-25b7-4291-a3d4-f6dc75e152a6 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.167683 Sep 12 23:29:51.227500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 152/309] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:51 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:51.537309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:51.537840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:51.544765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.545242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.545675 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.546356 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.546806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.547228 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.639234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:51.640240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:51.646119 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.646638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.647299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.648656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.649144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.649947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.677000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:51.684732 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c49506fd-daf2-42f2-9e22-45df5aeb705f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.151270 Sep 12 23:29:51.685293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 158/310] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:51 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:51.777087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:51.781449 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:51.786386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-786bf5f9-dba2-47c6-ae01-ccd9a7a64088 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1469 microversion: 2.1 time: 0.151089 Sep 12 23:29:51.786954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 153/311] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:51 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:51.794131 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:51.794594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:51.800379 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.800857 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.801291 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.801971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:51.802419 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:51.802837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:51.824295 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lazy-loading 'flavor' on Instance uuid e07d4dcb-1679-4627-b94b-adc34cfffbb3 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:52.047870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ec19ef59-bb11-41bf-bc59-50651d3d5f21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/action" status: 202 len: 0 microversion: 2.20 time: 0.257319 Sep 12 23:29:52.048439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 159/312] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Sep 12 23:29:51 2022] POST /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 12 23:29:52.057163 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:52.057762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:52.064616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.065094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.065523 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.066200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.066650 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.067066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.198082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:52.206019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:52.207453 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:52.208642 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-41f05621-6341-465f-a62e-a2fb1e769e99 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.155955 Sep 12 23:29:52.209196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 154/313] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:29:52 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:29:52.251948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:52.252662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:52.258823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.259292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.259747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.260413 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.260857 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.261268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.386468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:52.394779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4b2d2f3a-9dc0-42f0-87e3-5ebd1c660be7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.147047 Sep 12 23:29:52.395332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 160/314] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:52 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:52.708138 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:52.708748 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:52.714722 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.715208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.715730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.716420 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.716870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.717305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.808699 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:52.809304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:52.816131 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.816615 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.817046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.817728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:52.818183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:52.818602 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:52.844568 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:52.853839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8c11b3e0-361f-40fe-bdff-a9a206292f73 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.149423 Sep 12 23:29:52.854802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 155/315] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:52 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:53.087106 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:53.095319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3f37f5b8-524e-449c-bcff-b8a7eaf26fcb tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1469 microversion: 2.1 time: 0.290407 Sep 12 23:29:53.095908 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 161/316] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:52 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1469 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:53.235455 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:53.236083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:53.242253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:53.242867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:53.243155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:53.243892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:53.244368 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:53.244815 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:53.373221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:53.381671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:53.383097 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:53.384267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b99b6fb4-58e8-4f6f-a836-e591e4b2426c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.153244 Sep 12 23:29:53.384807 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 156/317] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:29:53 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:29:53.418840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:53.419447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:53.425827 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:53.426309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:53.426743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:53.427423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:53.427904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:53.428328 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:53.568903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:53.576669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-31ef5d24-e0b5-4f72-b2f5-35147b700e88 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.161531 Sep 12 23:29:53.577159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 162/318] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:53 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:53.879770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:53.880312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:53.886349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:53.886827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:53.887286 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:53.887992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:53.888441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:53.888860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:54.016681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:54.024454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ccce499b-338b-4334-a57e-9c76f80d0933 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.148802 Sep 12 23:29:54.025014 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 157/319] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:53 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:54.117851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:54.118455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:54.125595 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:54.126074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:54.126498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:54.127171 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:54.127639 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:54.128057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:54.258232 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:54.265791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f6dc680a-82e9-44ef-9ec8-b2a80c138b58 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1469 microversion: 2.1 time: 0.151798 Sep 12 23:29:54.266352 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 163/320] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:54 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:54.410181 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:54.410809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:54.416742 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:54.417219 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:54.417649 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:54.418328 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:54.418777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:54.419196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:54.545265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:54.554443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:54.555894 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:54.557045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dd66a063-02cc-4a81-9700-6b409709399f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.150723 Sep 12 23:29:54.557636 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 158/321] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:29:54 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:29:54.599409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:54.600166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:54.602102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:54.609055 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:54.609565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:54.609995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:54.610924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:54.611374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:54.611831 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:54.976568 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:54.984209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-eead5d58-5e8a-4520-81ec-c59515575ef0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.388646 Sep 12 23:29:54.984762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 164/322] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:54 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:55.047320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:55.047967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:55.053825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:55.054306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:55.054736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:55.055415 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:55.055890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:55.056318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:55.187010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:55.194548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-99594786-efbe-4c89-b0d4-b6ca36f93708 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.151053 Sep 12 23:29:55.195091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 159/323] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:55 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:55.289047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:55.289654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:55.296000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:55.296549 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:55.296980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:55.297658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:55.298103 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:55.298515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:55.446060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:55.454197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-713330de-8e73-4ebb-9347-8d70962aacd0 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1469 microversion: 2.1 time: 0.168879 Sep 12 23:29:55.454759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 165/324] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:55 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:55.582532 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:55.583292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:55.589648 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:55.590326 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:55.590910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:55.591781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:55.593273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:55.593703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:55.734576 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:55.743187 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:55.744939 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:55.746556 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-03fe4424-b011-4f0c-b49b-751966efb9b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.167976 Sep 12 23:29:55.747274 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 160/325] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:29:55 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:29:56.006776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:56.007387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:56.013272 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.013754 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.014805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.015486 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.015966 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.016389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.192542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:56.202228 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-03f2c37a-a2a3-4797-9cea-e8b34eb0465a tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1502 microversion: 2.1 time: 0.199153 Sep 12 23:29:56.202840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 166/326] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:56 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:56.217693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:56.218211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:56.224264 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.225070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.225696 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.226392 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.226836 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.227411 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.479556 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:56.480122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:56.488805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.489696 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.490266 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.491251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.491901 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.492318 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.494937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:56.506803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-677bcd5b-ec65-4105-b4e8-5c392cb8b3cf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.292917 Sep 12 23:29:56.507382 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 161/327] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:56 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:56.521419 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:56.714769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-da7f5073-147a-460b-aa30-055b40e61f79 req-7fc8db04-f69b-4c6c-9f86-df9f9b22fcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e47a7d-ea1f-4363-b801-a76ce8db7f23", "name": "network-vif-deleted", "tag": "9affba5c-e561-4b66-b889-1c5a4ca0fa50"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:56.732247 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-da7f5073-147a-460b-aa30-055b40e61f79 req-7fc8db04-f69b-4c6c-9f86-df9f9b22fcd6 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.732993 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-da7f5073-147a-460b-aa30-055b40e61f79 req-7fc8db04-f69b-4c6c-9f86-df9f9b22fcd6 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.733792 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-da7f5073-147a-460b-aa30-055b40e61f79 req-7fc8db04-f69b-4c6c-9f86-df9f9b22fcd6 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.763015 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-da7f5073-147a-460b-aa30-055b40e61f79 req-7fc8db04-f69b-4c6c-9f86-df9f9b22fcd6 service nova] Creating event network-vif-deleted:9affba5c-e561-4b66-b889-1c5a4ca0fa50 for instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 on hv-cinder-85200 Sep 12 23:29:56.773275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-da7f5073-147a-460b-aa30-055b40e61f79 req-7fc8db04-f69b-4c6c-9f86-df9f9b22fcd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062349 Sep 12 23:29:56.776937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 162/328] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:29:56.788817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:56.789892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:56.801140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:56.802992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.803678 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.804512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.805591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.806224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.806841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.817946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-01d37725-335c-48ff-b33e-7e2e85942cc3 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1469 microversion: 2.1 time: 0.343625 Sep 12 23:29:56.823712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 167/329] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:56 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:56.938721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-b3345232-0387-4454-85e9-104c10d8db2f req-cd90eeaa-32ec-4d5e-abf3-bd6de258b2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13bcc690-65ac-4aea-adf2-3a8337a3d83e", "name": "network-vif-deleted", "tag": "f2e1908c-7aa5-4fac-b276-d75bf334f55c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:29:56.959472 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b3345232-0387-4454-85e9-104c10d8db2f req-cd90eeaa-32ec-4d5e-abf3-bd6de258b2e5 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:56.960517 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b3345232-0387-4454-85e9-104c10d8db2f req-cd90eeaa-32ec-4d5e-abf3-bd6de258b2e5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:56.961179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b3345232-0387-4454-85e9-104c10d8db2f req-cd90eeaa-32ec-4d5e-abf3-bd6de258b2e5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:56.986647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-b3345232-0387-4454-85e9-104c10d8db2f req-cd90eeaa-32ec-4d5e-abf3-bd6de258b2e5 service nova] Creating event network-vif-deleted:f2e1908c-7aa5-4fac-b276-d75bf334f55c for instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e on hv-cinder-85200 Sep 12 23:29:56.993245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-b3345232-0387-4454-85e9-104c10d8db2f req-cd90eeaa-32ec-4d5e-abf3-bd6de258b2e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059732 Sep 12 23:29:56.994545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 168/330] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:29:57.048997 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:57.063513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:57.071118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:57.074934 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-350c42e6-ae8c-4bfc-9f95-c037b914f6f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.295244 Sep 12 23:29:57.088868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 163/331] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:29:56 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:29:57.234064 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:57.234827 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:57.247850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.248369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.250599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.253746 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.254307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.254745 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.308261 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.308743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.309176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.309623 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lazy-loading 'fault' on Instance uuid 09e47a7d-ea1f-4363-b801-a76ce8db7f23 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:57.381372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:57.390789 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b69a0b65-d445-4cba-a914-cdd99bd969df tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1303 microversion: 2.1 time: 0.168117 Sep 12 23:29:57.391353 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 169/332] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:57 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:57.531403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:57.531992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:57.533946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:29:57.539019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.539500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.539961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.540644 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.541094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.541517 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.673695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:57.681517 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3620f3cd-f997-48f6-9668-214bc7958543 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1522 microversion: 2.1 time: 0.154841 Sep 12 23:29:57.682077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 164/333] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:57 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:57.844781 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:57.845402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:57.852304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.853001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.853244 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.853954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.854412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.855064 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.888817 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:57.889872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:57.890313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:57.890771 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lazy-loading 'fault' on Instance uuid 13bcc690-65ac-4aea-adf2-3a8337a3d83e {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:57.931902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:57.939615 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f453cc8e-7f7c-4a3e-93d1-76ab941d3940 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1304 microversion: 2.1 time: 0.099406 Sep 12 23:29:57.940217 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 170/334] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:57 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:58.101828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:58.102452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:58.108432 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.108907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.109333 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.110009 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.110454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.110868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.238028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:58.246351 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:58.247885 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:58.249146 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6ead3ed6-e8ed-4df2-846f-20e8b2a96e29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.151256 Sep 12 23:29:58.249791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 165/335] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:29:58 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:29:58.417417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:58.418045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:58.423982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.424457 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.424879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.425551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.425997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.426416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.456873 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.457339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.457764 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.458198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lazy-loading 'fault' on Instance uuid 09e47a7d-ea1f-4363-b801-a76ce8db7f23 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:58.498357 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:58.505987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fa44a89a-5ba2-4091-abb0-3893bd7f8da5 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1303 microversion: 2.1 time: 0.092816 Sep 12 23:29:58.506541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 171/336] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:58 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:58.707305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:58.708112 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:58.714025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.714513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.714951 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.715672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.716171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.716602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.859464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:58.868224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b298dbc9-7d40-436d-9135-21c3783827b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1502 microversion: 2.1 time: 0.165666 Sep 12 23:29:58.868956 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 166/337] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:58 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:58.896705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:58.897454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:58.903169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.903680 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.904131 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.905098 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.905542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.905977 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.963457 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:58.964309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:58.970439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.971048 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.971606 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:58.972385 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:58.972911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:58.973343 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:59.004931 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:59.005442 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:59.005882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:59.006331 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lazy-loading 'fault' on Instance uuid 13bcc690-65ac-4aea-adf2-3a8337a3d83e {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:59.043963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:59.046283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:59.052047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-073ea9e3-b789-4391-9e23-3f7b323dbea8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1517 microversion: 2.1 time: 0.159654 Sep 12 23:29:59.052693 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 172/338] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:58 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:29:59.053845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ef2884aa-6f41-474a-b565-c03dd80cbac5 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1304 microversion: 2.1 time: 0.094420 Sep 12 23:29:59.054402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 167/339] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:58 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:29:59.274805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:59.275621 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:59.282947 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:59.283425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:59.283879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:59.284566 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:59.285013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:59.285433 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:59.429711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:59.437837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:59.439278 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:59.445147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c866567d-be46-4df0-9c3a-c85dff1b75fb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.170029 Sep 12 23:29:59.445147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 173/340] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:29:59 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:29:59.529161 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:29:59.530596 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:29:59.536552 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:59.537038 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:59.537475 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:59.538159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:59.538643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:59.539066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:59.569058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:29:59.569532 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:29:59.569965 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:29:59.570406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lazy-loading 'fault' on Instance uuid 09e47a7d-ea1f-4363-b801-a76ce8db7f23 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:29:59.609465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:29:59.616975 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bc67a8aa-8a57-42ff-ad40-0e7a65edd612 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1303 microversion: 2.1 time: 0.091733 Sep 12 23:29:59.617530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 168/341] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:29:59 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:00.077367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:00.077980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:00.084340 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.084813 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.085240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.085914 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.086361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.086776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.120968 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.121441 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.121869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.122303 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lazy-loading 'fault' on Instance uuid 13bcc690-65ac-4aea-adf2-3a8337a3d83e {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:30:00.161946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:00.169391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1063e45b-68a2-40e1-8353-0b42673e6035 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1304 microversion: 2.1 time: 0.095909 Sep 12 23:30:00.169945 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 174/342] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:00 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:00.466191 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:00.466898 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:00.473539 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.474048 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.474476 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.475427 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.475898 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.476318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.640843 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:00.641397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:00.647630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.648122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.648659 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.649402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.649970 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.650632 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.685290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:00.686415 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:00.686848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:00.687375 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lazy-loading 'fault' on Instance uuid 09e47a7d-ea1f-4363-b801-a76ce8db7f23 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:30:00.733257 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:00.741126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b36aec1b-e87d-4d62-b982-b6beeed6ed79 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1303 microversion: 2.1 time: 0.104803 Sep 12 23:30:00.741703 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 175/343] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:00 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:00.813681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:00.821826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:00.823262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:00.824426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8491db18-b72b-4a16-9c27-ae7a4cd23fdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.362264 Sep 12 23:30:00.824966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 169/344] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:00 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:01.192780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:01.193327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:01.199559 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.200067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.200495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.201165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.201609 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.202027 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.231870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.232335 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.233401 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.233834 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lazy-loading 'fault' on Instance uuid 13bcc690-65ac-4aea-adf2-3a8337a3d83e {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:30:01.272190 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:01.280113 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-68df5862-4ad0-42df-a842-89e576cde194 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1304 microversion: 2.1 time: 0.090613 Sep 12 23:30:01.280664 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 176/345] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:01 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:01.764926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:01.765460 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:01.771380 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.771889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.772319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.773001 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.773451 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.773869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.792064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:01.804587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.805057 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.805485 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.805921 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lazy-loading 'fault' on Instance uuid 09e47a7d-ea1f-4363-b801-a76ce8db7f23 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:30:01.844984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:01.848746 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:01.849346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:01.852527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d1625726-389e-4a82-acb1-bd8654385ed7 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1303 microversion: 2.1 time: 0.092019 Sep 12 23:30:01.853096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 170/346] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:01 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:01.855595 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.856089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.856514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.857188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:01.857629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:01.858044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:01.984547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:01.992369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:01.994052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:01.995189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-46993090-93d7-4143-91d5-18223223de5c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.150244 Sep 12 23:30:01.995753 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 177/347] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:01 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:30:02.301831 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:02.302363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:02.308317 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:02.308799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:02.309229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:02.309908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:02.310358 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:02.310776 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:02.340238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:02.340712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:02.341144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:02.341579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lazy-loading 'fault' on Instance uuid 13bcc690-65ac-4aea-adf2-3a8337a3d83e {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:30:02.380659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0a2c1fdc7945f6ac260c8e8ae7ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa4238c07c0476095fde3edb52432ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:02.388167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1d495006-f4aa-4113-b62f-ca0125d925c8 tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 200 len: 1304 microversion: 2.1 time: 0.090210 Sep 12 23:30:02.389241 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 171/348] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:02 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:02.874882 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:02.875409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:02.881897 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:02.882381 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:02.882820 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:02.883516 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:02.884002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:02.884431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:02.917298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:02.917784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:02.918225 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:02.918674 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lazy-loading 'fault' on Instance uuid 09e47a7d-ea1f-4363-b801-a76ce8db7f23 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:30:02.958400 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcd3dd65d5841049ed20e36e847bb53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b6882f873400fbef301fc5ce82391', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:02.965838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-69bb8dda-72d0-48a1-b14d-9c681e113df0 tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 200 len: 1303 microversion: 2.1 time: 0.094881 Sep 12 23:30:02.966401 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 178/349] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:02 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:03.020334 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:03.020958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:03.026785 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:03.027260 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:03.027719 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:03.028396 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:03.028839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:03.029255 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:03.159534 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:03.167562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:03.169026 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:03.170168 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c5bd484f-ba58-44b6-a0ce-f9f87f0abbb3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.153715 Sep 12 23:30:03.170713 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 172/350] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:03 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:03.413704 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:03.414295 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] [instance: 13bcc690-65ac-4aea-adf2-3a8337a3d83e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:03.421883 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:03.422353 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:03.423044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:03.423465 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:03.423948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:03.424366 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:03.440189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] HTTP exception thrown: Instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e could not be found. Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Request method failure captured: Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e HTTP/1.1 Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8DU5yGchRdDE8okMn7clIsXWW1yLJbTvwT6XlywwhR6_tzlIya_JRSVEVymD7L1RMD1BbWeWmDSvwDwugZiAMEi4W2YSYYrWLjy_cHST1TKBHl594MRKvk_h5jgNW50jPXzPD7aURIbm4i-NjzcEvIUWH4u3z502T0zx4i7JEjyN1k Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 6fa4238c07c0476095fde3edb52432ef Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesNegativeTest-1136349795 Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:30:03.441832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fa4238c07c0476095fde3edb52432ef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fa4238c07c0476095fde3edb52432ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fa4238c07c0476095fde3edb52432ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fa4238c07c0476095fde3edb52432ef"}]}] Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesNegativeTest-1136349795 Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 6fa4238c07c0476095fde3edb52432ef Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesNegativeTest-1136349795 Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesNegativeTest-1136349795-project Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: ec0a2c1fdc7945f6ac260c8e8ae7ad4d Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesNegativeTest-1136349795-project Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e could not be found. Sep 12 23:30:03.443425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '13bcc690-65ac-4aea-adf2-3a8337a3d83e'} Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e could not be found. Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:30:03.444351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e could not be found. Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e could not be found. Sep 12 23:30:03.445784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:03.447178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] Returning 404 to user: Instance 13bcc690-65ac-4aea-adf2-3a8337a3d83e could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:30:03.447178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-25c20066-4262-4de9-bd3d-71da0341188e tempest-VolumesNegativeTest-1136349795 tempest-VolumesNegativeTest-1136349795-project] 10.222.0.27 "GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e" status: 404 len: 111 microversion: 2.1 time: 0.035103 Sep 12 23:30:03.447178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 179/351] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:03 2022] GET /compute/v2.1/servers/13bcc690-65ac-4aea-adf2-3a8337a3d83e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:30:03.990857 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:03.991513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] [instance: 09e47a7d-ea1f-4363-b801-a76ce8db7f23] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:04.001084 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.001602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.002032 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:04.002743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.003237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.003611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:04.018864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] HTTP exception thrown: Instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 could not be found. Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Request method failure captured: Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 HTTP/1.1 Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8Cs4hwxCpxGReZWSriFij2CQ81tN7sVqRj0z1h_nJnLaXtUEDOwBJkQK4xyvrYGHraJC5kpYzWtVWBsmM3OaD4V8sQ2ZPXpVSLF9QUzevGyqy2OeZfkBwOGzA9k3WML-zHQXIDS3E7CJDrGQrGgOSZnC5LCGCfysX3nJ57dQIBSP24 Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 641b6882f873400fbef301fc5ce82391 Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesActionsTest-1780566035 Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:30:04.022028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_641b6882f873400fbef301fc5ce82391", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/641b6882f873400fbef301fc5ce82391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641b6882f873400fbef301fc5ce82391"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/641b6882f873400fbef301fc5ce82391"}]}] Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesActionsTest-1780566035 Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 641b6882f873400fbef301fc5ce82391 Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesActionsTest-1780566035 Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesActionsTest-1780566035-project Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 2dcd3dd65d5841049ed20e36e847bb53 Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesActionsTest-1780566035-project Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 could not be found. Sep 12 23:30:04.023972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '09e47a7d-ea1f-4363-b801-a76ce8db7f23'} Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 could not be found. Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:30:04.027778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 could not be found. Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 could not be found. Sep 12 23:30:04.029076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:30:04.030932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] Returning 404 to user: Instance 09e47a7d-ea1f-4363-b801-a76ce8db7f23 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:30:04.030932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-981e2e13-85d1-4cd6-9b25-5c93663e9cec tempest-VolumesActionsTest-1780566035 tempest-VolumesActionsTest-1780566035-project] 10.222.0.27 "GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23" status: 404 len: 111 microversion: 2.1 time: 0.036859 Sep 12 23:30:04.030932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 173/352] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:03 2022] GET /compute/v2.1/servers/09e47a7d-ea1f-4363-b801-a76ce8db7f23 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:30:04.196156 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:04.198024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:04.205083 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.205753 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.206327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:04.207188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.207921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.208493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:04.396952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:04.408113 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:04.409915 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:04.415500 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a793ae96-589c-4764-b7ba-e78f053f7876 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.224748 Sep 12 23:30:04.416180 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 180/353] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:04 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:04.675415 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:04.677336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:04.683701 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.684329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.684830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:04.686456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.687073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.687562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:04.716553 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lazy-loading 'flavor' on Instance uuid 1398a779-68bf-4ec4-b196-d359ee0e7b8c {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:30:04.836302 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2621cfa7-468f-412f-9ab3-83de635a44d6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c/action" status: 200 len: 32 microversion: 2.1 time: 0.166461 Sep 12 23:30:04.842465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 174/354] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:30:04 2022] POST /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:30:04.847015 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:04.847948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:04.859811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.860311 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.860750 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:04.861467 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:04.861923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:04.862352 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:05.063458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:05.074132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4fbf9e91-81a9-4488-ab4f-f75b18b60031 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.230867 Sep 12 23:30:05.091676 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 181/355] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:04 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:05.441868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:05.442555 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:05.448703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:05.449186 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:05.449611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:05.450515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:05.451055 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:05.451417 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:05.600229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:05.610491 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:05.611962 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:05.613151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b9792b42-3fa0-4be0-981b-79eb7f7168cc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.175811 Sep 12 23:30:05.613699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 175/356] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:05 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:06.099031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:06.099861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:06.110252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:06.110811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:06.111154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:06.111881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:06.112335 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:06.112778 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:06.272051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:06.279893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:06.283335 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-243b9c52-05f8-49f8-a65c-61c9409f9960 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.188783 Sep 12 23:30:06.284227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 182/357] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:06 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:06.639732 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:06.640581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:06.646595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:06.647301 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:06.647759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:06.648450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:06.648990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:06.649447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:06.799924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:06.808907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:06.810450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:06.811631 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c2766bfd-796c-4393-aefd-75dd3052754c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.176980 Sep 12 23:30:06.812339 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 176/358] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:06 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:07.306382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:07.307012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:07.314965 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:07.315454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:07.315933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:07.316633 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:07.317132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:07.317559 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:07.450730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:07.458788 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-926045a9-e543-43b0-a7e7-d29a555a91cc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.156323 Sep 12 23:30:07.459476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 183/359] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:07 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:07.838079 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:07.838708 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:07.844714 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:07.845231 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:07.845659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:07.846341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:07.846784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:07.847393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:07.989350 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:07.997537 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:07.999561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:08.000795 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-02859511-29ed-41dc-9a15-85cbace3fb9c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.166654 Sep 12 23:30:08.001349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 177/360] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:07 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:08.481115 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:08.481731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:08.489138 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:08.489624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:08.490319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:08.491407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:08.492554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:08.493047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:08.641080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:08.649004 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3e9c1277-8373-4710-95e7-2c59ffcaff0e tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.171515 Sep 12 23:30:08.649631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 184/361] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:08 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:08.994995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:08.996150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:09.003591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:09.004114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:09.004753 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:09.005448 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:09.005933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:09.006362 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:09.028250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:09.028891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:09.036121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:09.036898 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:09.037407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:09.037546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-462489a7-2eb3-4d25-8e15-b32a6efd9d09 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/ips" status: 200 len: 145 microversion: 2.1 time: 0.046157 Sep 12 23:30:09.038284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:09.038810 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:09.038968 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 178/362] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:30:08 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:30:09.039415 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:09.176627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:09.184967 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:09.186990 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:09.188160 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85888def-bcd7-4a23-bf6b-a086844cd9b4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.164058 Sep 12 23:30:09.188710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 185/363] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:09 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:30:09.674527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:09.675059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:09.681438 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:09.682352 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:09.683030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:09.683981 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:09.684750 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:09.685469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:09.847012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:09.854744 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-05a8d376-d9a6-4f50-bfb3-50c9cfe74978 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.184126 Sep 12 23:30:09.855300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 179/364] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:09 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:10.213684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:10.214308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:10.224573 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:10.226405 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:10.226846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:10.231690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:10.233034 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:10.233660 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:10.505568 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:10.517922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:10.522537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:10.525012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-313f2a81-f73a-4933-a83e-33599954863a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.315495 Sep 12 23:30:10.529832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 186/365] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:10 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:10.952656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:10.953315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:10.998987 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:11.001041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:11.002866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:11.004536 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:11.005275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:11.006113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:11.240091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:11.251530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2c403484-aafe-4167-b776-fc4bc6f31114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.371635 Sep 12 23:30:11.273429 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 180/366] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:10 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:11.556538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:11.557294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:11.573268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:11.573973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:11.574521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:11.579881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:11.582909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:11.583640 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:11.934696 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:11.951419 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:11.953148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:11.957265 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-892b3b89-1b88-4923-8728-ff4e30ef087e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.405279 Sep 12 23:30:11.972709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 187/367] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:11 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:12.288023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:12.294887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:12.313154 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:12.315176 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:12.317895 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:12.320941 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:12.321770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:12.323620 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:12.676677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:12.686057 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c750f4c8-c1ff-44cb-9226-a1820dc8d639 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.409259 Sep 12 23:30:12.692048 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 181/368] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:12 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:12.790972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8cc1c12-c556-4a5a-a272-99d3cbc85ac6"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:12.797527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:12.808847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:12.810812 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:12.811503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:12.813162 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:12.813775 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:12.814958 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:12.989890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:12.990632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:13.003162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:13.003728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:13.004170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:13.004924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:13.005401 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:13.005852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:13.430342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:13.439023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:13.445171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:13.450024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-491bba0c-4d58-4fb8-8139-4af2cc6c7e1f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666975 Sep 12 23:30:13.470057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 188/369] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:30:12 2022] POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:30:13.470432 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-188fd77b-d41c-4508-9df3-d63d7f0e39a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.460917 Sep 12 23:30:13.472973 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 182/370] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:12 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:13.720322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:13.721256 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:13.736331 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:13.737186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:13.737966 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:13.738929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:13.741716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:13.742459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:14.058911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:14.074049 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8d53c4fb-3e1e-4e21-92d4-a093c23fcb53 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.359583 Sep 12 23:30:14.077153 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 189/371] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:13 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:14.506684 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:14.508019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:14.516923 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:14.519916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:14.522689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:14.526226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:14.526726 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:14.527173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:15.101348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:15.101920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:15.116716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:15.119747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:15.123371 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:15.127250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:15.128000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:15.131239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:15.258332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:15.270440 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:15.273876 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:15.275472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9d6154dc-cccb-447f-9940-3b0413f2ce87 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.773356 Sep 12 23:30:15.295149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 183/372] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:14 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:15.562380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:15.588756 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0b7a907b-581c-41bd-b3be-a62d25311080 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.479343 Sep 12 23:30:15.610777 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 190/373] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:15 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:16.309010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:16.313538 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:16.335430 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:16.340271 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:16.340752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:16.353845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:16.354515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:16.364196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:16.616706 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:16.619603 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:16.638796 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:16.642440 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:16.643928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:16.648005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:16.648689 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:16.650619 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:17.036565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:17.045830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:17.052824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:17.056402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-49573896-cf43-4d2c-aafa-6ddaeb51d72f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.753627 Sep 12 23:30:17.057208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 184/374] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:16 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:17.083377 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:17.104654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-79f3e623-a8b0-4fe9-8c63-f89b40fa4c9b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.486718 Sep 12 23:30:17.119695 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 191/375] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:16 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:18.085046 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:18.085694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:18.093390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:18.093903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:18.094384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:18.095104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:18.095604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:18.096072 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:18.135316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:18.136904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:18.173799 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:18.176025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:18.177326 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:18.181722 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:18.182718 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:18.183224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:18.189389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:18.581716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:18.588045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:18.597326 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2d90610d-4722-40ce-99a0-1cf068176fa9 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.467241 Sep 12 23:30:18.598451 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 192/376] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:18 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:18.623014 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:18.627349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:18.631693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-61affbe2-219c-46a2-9132-edf1e4e224b2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1745 microversion: 2.20 time: 0.548344 Sep 12 23:30:18.632948 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 185/377] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:18 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1745 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:19.624956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:19.626215 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:19.639244 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:19.642445 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:19.643085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:19.644042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:19.648221 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:19.649620 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:19.664073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:19.665234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:19.680689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:19.681450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:19.686721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:19.687803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:19.692277 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:19.692900 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:20.005087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:20.014036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:20.016092 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:20.017624 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-744a8d68-a638-4f36-b24f-5b176ff99a6f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1745 microversion: 2.20 time: 0.357507 Sep 12 23:30:20.032482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 186/378] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:19 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1745 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:20.063840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:20.073431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2454ba63-367b-45d1-b8c0-05fe73785b9d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.452613 Sep 12 23:30:20.074020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 193/379] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:19 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:21.045996 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:21.046604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:21.054917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:21.055406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:21.062357 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:21.063464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:21.064114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:21.064706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:21.099753 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:21.100364 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:21.110777 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:21.111285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:21.116348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:21.117170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:21.117660 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:21.118084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:21.385182 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:21.396929 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:21.398370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:21.404610 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3c7c7021-198e-4577-b19d-46dbc0467a2e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1745 microversion: 2.20 time: 0.358304 Sep 12 23:30:21.405235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 187/380] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:21 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1745 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:30:21.691471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:21.723991 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c427ae44-2724-4683-8002-824774b67585 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.619774 Sep 12 23:30:21.726864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 194/381] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:21 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:22.435323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:22.435954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:22.456927 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:22.457428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:22.457868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:22.460202 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:22.460711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:22.461930 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:22.725274 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:22.737960 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:22.740467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:22.742877 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-aacc1a28-1605-4fb8-9587-a37b38fa7eba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1745 microversion: 2.20 time: 0.311494 Sep 12 23:30:22.753054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:22.754813 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:22.758186 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 188/382] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:22 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1745 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:22.768406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:22.770432 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:22.771891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:22.774367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:22.777872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:22.779250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:23.045415 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:23.054254 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-68f6c41f-b691-4d75-ab3f-e954751afc2a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.304893 Sep 12 23:30:23.054840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 195/383] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:22 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:23.786619 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:23.788025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:23.794348 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:23.795088 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:23.795799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:23.796750 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:23.797270 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:23.797902 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:24.018817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:24.027362 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:24.028894 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:24.030347 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-353c8128-0bf4-4f05-b648-9d58fdc346a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1745 microversion: 2.20 time: 0.247810 Sep 12 23:30:24.044478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 189/384] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:23 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1745 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:24.080030 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:24.080822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:24.087538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:24.088284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:24.088739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:24.089527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:24.090067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:24.090538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:24.352504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:24.360963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f3e01ae8-507c-4917-ba11-f88b407e96fd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.284698 Sep 12 23:30:24.375996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 196/385] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:24 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:25.048924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-e492286b-86af-44bd-a81a-661d8f0faa6e req-e2738687-f7ba-4135-a719-0af5274d789b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d4dcb-1679-4627-b94b-adc34cfffbb3", "name": "network-vif-plugged", "status": "completed", "tag": "fbdc10fe-ce53-41fd-a771-18e381482273"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:25.066157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:25.066768 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:25.089727 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=80 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:25.098874 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:25.105803 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:25.110845 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:25.117770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:25.119089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:25.124004 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-e492286b-86af-44bd-a81a-661d8f0faa6e req-e2738687-f7ba-4135-a719-0af5274d789b service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:25.124732 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:25.132355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-e492286b-86af-44bd-a81a-661d8f0faa6e req-e2738687-f7ba-4135-a719-0af5274d789b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:25.132972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-e492286b-86af-44bd-a81a-661d8f0faa6e req-e2738687-f7ba-4135-a719-0af5274d789b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:25.192244 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-e492286b-86af-44bd-a81a-661d8f0faa6e req-e2738687-f7ba-4135-a719-0af5274d789b service nova] Creating event network-vif-plugged:fbdc10fe-ce53-41fd-a771-18e381482273 for instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 on hv-cinder-85200 Sep 12 23:30:25.208257 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-e492286b-86af-44bd-a81a-661d8f0faa6e req-e2738687-f7ba-4135-a719-0af5274d789b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163571 Sep 12 23:30:25.209559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 190/386] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:30:25.392335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-53ab833a-e18c-4636-add2-869b715ec3ee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:25.410487 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-53ab833a-e18c-4636-add2-869b715ec3ee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:25.415994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-53ab833a-e18c-4636-add2-869b715ec3ee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:25.420551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-53ab833a-e18c-4636-add2-869b715ec3ee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:25.632116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-53ab833a-e18c-4636-add2-869b715ec3ee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Going to try to stop instance {{(pid=120622) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 23:30:25.719111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-53ab833a-e18c-4636-add2-869b715ec3ee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action" status: 202 len: 0 microversion: 2.1 time: 0.336353 Sep 12 23:30:25.723756 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 191/387] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:30:25 2022] POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:30:25.730275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:25.731903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:25.739781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:25.740537 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:25.741257 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:25.742270 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:25.742885 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:25.743674 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:25.996501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:26.013115 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-976c7e79-b3da-4240-8002-69243f11f7f0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.280664 Sep 12 23:30:26.014101 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 192/388] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:25 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:26.019845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:26.020738 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:26.027450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:26.028376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:26.029295 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:26.030487 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:26.031159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:26.034962 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:26.204313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:26.213265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:26.215260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:26.217019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:26.220860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9d7adeb0-8388-4dba-83e4-70990fa068a2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 1.168388 Sep 12 23:30:26.235830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cc94c361-c854-4d7a-872b-24a04a211de3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.218663 Sep 12 23:30:26.235830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 193/389] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:26 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:26.244025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 197/390] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:25 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:27.040397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:27.041262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:27.051544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:27.055682 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:27.056394 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:27.057132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:27.057598 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:27.058027 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:27.252555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:27.253909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:27.265972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:27.273955 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:27.275202 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d8e234b1-3a5d-4115-b61d-708b0af06f68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.238638 Sep 12 23:30:27.275532 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:27.276241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:27.277474 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:27.278259 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:27.278918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:27.288437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 194/391] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:27 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:27.298274 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:27.299725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:27.307342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:27.308538 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:27.309135 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:27.310573 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:27.311293 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:27.311905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:27.337890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:27.555884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:27.564870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-149cc31f-2e32-4e4a-a7e0-bb74bcd722f1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.274991 Sep 12 23:30:27.565456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 195/392] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:27 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:27.573109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:27.584135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:27.586819 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:27.592043 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ce4639b4-61d8-4b22-895e-ba1e8c1d73c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.343625 Sep 12 23:30:27.603595 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 198/393] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:27 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:28.302953 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:28.304188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:28.313573 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=72 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:28.316282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:28.318334 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:28.320177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:28.323587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:28.324349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:28.325699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:28.589805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:28.593383 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:28.609952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:28.615143 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:28.620912 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:28.624658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:28.626918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:28.627501 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:28.810779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:28.827654 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-05effd81-441d-489d-87b0-122a5affd7ce tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.528058 Sep 12 23:30:28.834655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 196/394] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:28 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:28.849277 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:28.852062 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:28.870769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:28.871314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:28.872252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:28.876980 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:28.878465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:28.880855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:29.221737 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:29.245001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c2096a82-6e4b-4a07-8193-69c1d67279fa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.658884 Sep 12 23:30:29.245999 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 199/395] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:28 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:29.286057 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:29.302736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:29.306099 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:29.311178 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d8b41d99-3613-48d6-9ab9-56528c591fcd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.468480 Sep 12 23:30:29.312972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 197/396] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:28 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:29.858350 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:29.858972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:29.876285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:29.880757 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:29.882088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:29.886234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:29.889851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:29.890511 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:30.183853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:30.194901 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7702c56f-75c3-49c3-9dee-cbf7e006e88d tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.340313 Sep 12 23:30:30.195487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 200/397] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:29 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:30.273930 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:30.274731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:30.281633 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:30.298868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:30.299736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:30.302114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:30.302781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:30.303867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:30.692758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:30.704476 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1879c3fc-3376-471e-83e6-519c29d78874 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.434258 Sep 12 23:30:30.705158 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:30 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:30.746583 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:30.747245 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:30.770317 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:30.779151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:30.779958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:30.781056 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:30.783169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:30.788007 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:31.099476 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:31.109253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:31.112694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:31.114134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-abaac606-2eb8-49a2-a76f-fde8b9c51ed1 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.385076 Sep 12 23:30:31.114870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 199/399] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:30 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:31.228715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:31.237488 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:31.256402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:31.258281 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:31.260655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:31.262042 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:31.263581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:31.265141 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:31.419546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-22aa0ce9-6fc3-42db-bd83-05633b9f70ac tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Action: 'create', calling method: .version_select at 0x7fa4b3868d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1903603689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdApC9KaKoKXYYdVZPqJNiUTCpv0qYQijiu8ov19Rk3XTf15RJ+tCXzEIh+VDZbUCqSJLmmrvjZqgc36emBNTbNCqv5uk3Oj8qQGd+QE7eqo10StGYOINAe3slhUn1wQQ=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:31.483883 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-22aa0ce9-6fc3-42db-bd83-05633b9f70ac tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for project eaa5d21fc40540e4b811713e5efeff46. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:30:31.496423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-22aa0ce9-6fc3-42db-bd83-05633b9f70ac tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for user 2d62232282dc4455834857d5290eb169 and project eaa5d21fc40540e4b811713e5efeff46. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:30:31.562355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-22aa0ce9-6fc3-42db-bd83-05633b9f70ac tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.266489 Sep 12 23:30:31.564588 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 201/400] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:30:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:30:31.611756 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:31.630000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-af346431-85e2-4c54-bb00-4c95fa4768a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.409240 Sep 12 23:30:31.631469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 200/401] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:31 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:31.733730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:31.735209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:31.751118 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:31.752214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:31.752916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:31.755751 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:31.756489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:31.759092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:32.143903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:32.145599 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:32.170013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:32.174927 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:32.177838 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:32.179511 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:32.182854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:32.184739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:32.580576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:32.602755 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-408a8392-81c3-4d9f-a33b-da232a51c320 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.863901 Sep 12 23:30:32.603946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 202/402] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:31 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:32.661404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:32.665229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:32.705777 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:32.706278 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:32.706714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:32.707420 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:32.707906 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:32.708328 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:32.783611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:32.798529 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:32.817626 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:32.821313 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:32.825988 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-81fe8d8c-975e-4731-9275-eb8542eccf09 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.687335 Sep 12 23:30:32.846148 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 201/403] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:32 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:33.253934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:33.262094 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-067e93be-0e94-49b1-a420-acbfddf91d38 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.609268 Sep 12 23:30:33.281046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 203/404] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:32 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:33.631906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:33.632527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:33.655705 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:33.656119 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:33.660968 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:33.664733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:33.669157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:33.678908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:33.858603 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:33.859587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:33.889274 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:33.893947 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:33.898937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:33.902124 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:33.902857 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:33.903421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:34.260816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:34.294205 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dcfcbf42-0284-4860-9a1c-8913b0eb4528 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.666818 Sep 12 23:30:34.294802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 202/405] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:33 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:34.339610 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:34.340735 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:34.376029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:34.376684 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:34.377431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:34.378169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:34.378632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:34.379066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:34.435816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:34.455045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:34.459517 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:34.465276 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2d5ab97a-c1c1-447c-ad51-cbaa2e3ad382 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.611347 Sep 12 23:30:34.468444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 204/406] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:33 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:34.992722 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:35.038601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a96ebd99-9fd3-4af6-b02e-6d9375f3057a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1503 microversion: 2.1 time: 0.731242 Sep 12 23:30:35.043781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 203/407] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:34 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1503 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:35.074026 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6aa327e-50a0-46ad-aaab-9f6bcbd23e2c"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:35.086940 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:35.125086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.125086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.125549 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.130157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.135748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.140705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.240402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] HTTP exception thrown: Cannot 'attach_volume' instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c while it is in vm_state rescued Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Request method failure captured: Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c/os-volume_attachments HTTP/1.1 Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 74 Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CQG8HWeNfiOq8aQUdKHghkL1T74BE2NK7glrno7hGRP54QGm9BSgGXmwXMs2E-pxWIdN3TMzPYtwdXcoJv4iZlV4avk6LOr7rxtXGI_UiurrLxxb7ejEy2_TxfEYaUxoqyNtg7kEOL-rgzugQdbzNpgJOhNTsdgyZKuJDgq9Bx2eU Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:30:35.243473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc049ff85c14935a9f68be76cd61c05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}] Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 0248519bf5b54ce3ba3b40f2c9a4c628 Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {"volumeAttachment": {"volumeId": "d6aa327e-50a0-46ad-aaab-9f6bcbd23e2c"}} Sep 12 23:30:35.245142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Cannot 'attach_volume' instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c while it is in vm_state rescued Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'server_id': '1398a779-68bf-4ec4-b196-d359ee0e7b8c', 'body': {'volumeAttachment': {'volumeId': 'd6aa327e-50a0-46ad-aaab-9f6bcbd23e2c'}}} Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:30:35.246122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c while it is in vm_state rescued Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:30:35.247637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:30:35.249070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:30:35.249070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:30:35.249070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c while it is in vm_state rescued Sep 12 23:30:35.249070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:30:35.253997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Returning 409 to user: Cannot 'attach_volume' instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c while it is in vm_state rescued {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:30:35.261638 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-383946e4-f792-4754-a69f-eff3bf5a23d0 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.193630 Sep 12 23:30:35.267030 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 205/408] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:30:35 2022] POST /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c/os-volume_attachments => generated 152 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 12 23:30:35.276803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:35.277335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:35.289721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.290226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.290649 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.295802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.296362 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.296801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.327115 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:35.327938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:35.339403 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.341784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.342412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.344019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.346047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.346690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.562042 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9c771eca-ce84-44c7-93b9-f2806903da3a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c/action" status: 202 len: 0 microversion: 2.1 time: 0.289367 Sep 12 23:30:35.564230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 204/409] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:30:35 2022] POST /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:30:35.577743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:35.578384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:35.622245 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.622744 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.623185 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.623920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.624376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.624802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.747747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:35.762725 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-27aebf2e-cbf8-4bf7-9c0e-663d051e246a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.445245 Sep 12 23:30:35.766986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 206/410] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:35 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:35.773778 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:35.774645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:35.782308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.783104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.783753 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:35.784624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:35.785263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:35.786112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:36.221212 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:36.235591 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-78da7754-f267-4c46-8fc7-fb1b6441ec56 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1511 microversion: 2.1 time: 0.466031 Sep 12 23:30:36.240316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 207/411] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:35 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1511 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:36.357639 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:36.378501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:36.380130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:36.385387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8a49f373-af52-402c-9c64-8c983892bbaf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.814366 Sep 12 23:30:36.388585 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 205/412] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:35 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:36.792371 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:36.794680 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:36.814839 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:36.820822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:36.824761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:36.828188 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:36.831762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:36.834153 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:37.269370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:37.274387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:37.286682 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:37.288461 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:37.290553 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:37.293308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:37.294577 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:37.296064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:37.360277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:37.370127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fa9306cd-d2a4-4fd7-8215-fb043f74ad1c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.583111 Sep 12 23:30:37.373735 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 208/413] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:36 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:37.418001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:37.418906 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:37.432373 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:37.435735 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:37.436649 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:37.437556 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:37.438186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:37.439329 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:37.695855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:37.716603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8e7d8e2b-6ab8-4e70-86ec-5d99a642bffd tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1511 microversion: 2.1 time: 0.451909 Sep 12 23:30:37.731844 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 206/414] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:37 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:37.798550 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:37.812656 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:37.814118 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:37.822784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f8a6bc2e-db0d-4e93-9752-dd23f83c819f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.405270 Sep 12 23:30:37.823953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 209/415] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:37 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:30:38.398291 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:38.398962 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:38.416170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:38.421908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:38.422569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:38.423598 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:38.432948 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:38.434512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:38.746353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:38.753736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:38.754326 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:38.769340 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:38.769828 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:38.775521 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f5984a90-9954-421d-b50f-b454956a73ba tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.381614 Sep 12 23:30:38.784535 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:38.786944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:38.789088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:38.789774 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:38.795617 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 207/416] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:38 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:38.858444 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:38.859832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:38.870900 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:38.872466 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:38.874269 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:38.881152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:38.882690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:38.884121 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:39.135792 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:39.152493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3db130d0-58ff-4dcc-9d2e-c54b32650c97 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1511 microversion: 2.1 time: 0.402673 Sep 12 23:30:39.175973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 210/417] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:38 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:39.292071 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:39.334392 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:39.343719 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:39.356301 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-faa96195-aede-4928-95b3-2b501e376453 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.505687 Sep 12 23:30:39.358978 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 208/418] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:38 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:39.833097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:39.834741 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:39.875966 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:39.876726 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:39.877450 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:39.878338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:39.879237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:39.883123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:40.184917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:40.186012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:40.206305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:40.206806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:40.207315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:40.226355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:40.231800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:40.241534 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:40.310057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:40.327116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ca1fbdc4-8eac-4c0c-b99b-a9810b6c92aa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.527199 Sep 12 23:30:40.329361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 211/419] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:39 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:40.398493 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:40.399139 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:40.421147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:40.421652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:40.422085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:40.422796 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:40.423251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:40.423948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:40.557671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:40.572919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-44f96501-1c71-44ee-8ff4-1e901ee08109 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1517 microversion: 2.1 time: 0.393871 Sep 12 23:30:40.592999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 209/420] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:40 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1517 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:40.783552 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:40.797416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:40.799059 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:40.801132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cff8d262-f167-4723-845a-cbbb07bfefe0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.412136 Sep 12 23:30:40.804932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 212/421] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:40 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:30:41.353763 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:41.354522 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:41.378296 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:41.379716 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:41.380273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:41.388721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:41.391082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:41.393529 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:41.723976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:41.763421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7651e6b2-4661-4b9a-92e3-bd3293f01156 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.411992 Sep 12 23:30:41.768153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 210/422] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:41 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:41.838360 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:41.841397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:41.857857 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:41.861869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:41.867937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:41.868743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:41.869736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:41.875135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:41.876904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:42.274239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:42.288402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:42.298304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:42.300751 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-df9b2b2c-c40d-45e5-bf30-b345521aab1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.470047 Sep 12 23:30:42.302210 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 213/423] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:41 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:42.456705 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0c7f409f-d0b5-4c20-b2f7-0a64fcb2af4b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'create', calling method: .version_select at 0x7fa4b3ba2550>, body: {"keypair": {"name": "tempest-keypair-1833672688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkByPgjWKTcfPvoLWueaP+dYZ43Gg5dFbuLXwOL/QWvTohLAErFnUE5tt8Mzx9n3HFD9ZxHKqDV8CLb3Rn+8n+FvARDVLFAwAEPJ14v+hHxqFfokZh1qlXDFkTfgWJN+w=="}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:42.517425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-0c7f409f-d0b5-4c20-b2f7-0a64fcb2af4b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for project adc049ff85c14935a9f68be76cd61c05. Resources: {'key_pairs'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:30:42.529621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-0c7f409f-d0b5-4c20-b2f7-0a64fcb2af4b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for user 0248519bf5b54ce3ba3b40f2c9a4c628 and project adc049ff85c14935a9f68be76cd61c05. Resources: {'key_pairs'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:30:42.629622 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0c7f409f-d0b5-4c20-b2f7-0a64fcb2af4b tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178902 Sep 12 23:30:42.638748 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 211/424] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:30:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:30:42.798455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:42.799503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:42.813072 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:42.824144 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:42.825073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:42.826339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:42.828050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:42.830864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:43.321521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:43.334578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:43.338722 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:43.340636 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7a8768f3-a4e0-42c2-9692-de5de7e7ba75 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1723 microversion: 2.1 time: 0.546625 Sep 12 23:30:43.341631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 214/425] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:42 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1723 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:43.346592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:43.347312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:43.347764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:43.348608 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:43.349214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:43.349779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:43.826427 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:43.854043 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:43.856905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:43.858640 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bfb361ca-5c1e-4ec4-9a2d-00de05a03679 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.530255 Sep 12 23:30:43.859749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 212/426] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:43 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:44.368260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:44.370537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:44.393800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:44.396372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:44.396830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:44.397800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:44.398517 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:44.398951 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:44.840436 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:44.873142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b8bb4993-0cf3-4e7b-b90b-cad112ac8afa tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1700 microversion: 2.1 time: 0.499890 Sep 12 23:30:44.899055 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 215/427] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:44 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1700 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:44.933630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a9bfd99b-26c1-47e8-9b94-a180f500f0e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:44.942368 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:44.944560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:44.955860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:44.977239 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:44.978470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:44.979511 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:44.980420 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:44.984624 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:44.995093 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9bfd99b-26c1-47e8-9b94-a180f500f0e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:44.997185 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9bfd99b-26c1-47e8-9b94-a180f500f0e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:44.997638 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9bfd99b-26c1-47e8-9b94-a180f500f0e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:45.100506 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:45.188322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a9bfd99b-26c1-47e8-9b94-a180f500f0e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Going to try to start instance {{(pid=120621) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 23:30:45.310097 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:45.328757 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:45.330094 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a9bfd99b-26c1-47e8-9b94-a180f500f0e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action" status: 202 len: 0 microversion: 2.1 time: 0.398966 Sep 12 23:30:45.331634 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:45.346571 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 216/428] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:30:44 2022] POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:30:45.353823 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a885bc23-2222-4feb-b515-36c201238322 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.449351 Sep 12 23:30:45.370478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 213/429] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:44 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:30:45.394417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:45.395920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:45.406029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:45.406563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:45.407176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:45.408364 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:45.408961 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:45.409592 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:46.335984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:46.354224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-28fb264a-df16-4ea7-8fef-8030d28d1634 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1709 microversion: 2.1 time: 1.000681 Sep 12 23:30:46.358441 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 217/430] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:45 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1709 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:46.383250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:46.390827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:46.420324 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:46.421122 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:46.422265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:46.426690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:46.430029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:46.430754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:46.827257 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:46.838754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:46.844643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:46.846224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-63686ef9-de41-462b-8214-1d703f24641b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.466926 Sep 12 23:30:46.860984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 214/431] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:46 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:47.250445 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2073279513", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06716bca-7ab1-4703-8226-2e627ce51e59"}], "security_groups": [{"name": "tempest-securitygroup--391481045"}], "key_name": "tempest-keypair-1833672688", "user_data": "}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:47.392240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:47.392845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:47.407381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:47.408155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:47.408759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:47.410604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:47.411236 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:47.418416 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:47.793793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:47.806976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-15f4c7e9-e7ef-4c20-ab00-daa66c4f9ca2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1709 microversion: 2.1 time: 0.424589 Sep 12 23:30:47.813260 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 215/432] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:47 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1709 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:47.878324 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:47.879350 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:47.893213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:47.894647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:47.902728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:47.904307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:47.905019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:47.905676 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:48.208388 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:48.220730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:48.222278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:48.227242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-95b60ba0-4fd1-4cee-b8a1-c8da20c7c488 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.354010 Sep 12 23:30:48.232601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 216/433] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:47 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:48.847781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:48.848326 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:48.861496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:48.862113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:48.862589 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:48.879606 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:48.882129 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:48.882786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:49.033343 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] validate_networks() for [('06716bca-7ab1-4703-8226-2e627ce51e59', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:30:49.213323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:49.231276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-151a8294-68ad-4d53-bf14-58670c22e402 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1713 microversion: 2.1 time: 0.392855 Sep 12 23:30:49.232353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 217/434] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:48 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1713 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:49.266284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:49.269548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:49.284366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:49.285416 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:49.286132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:49.287429 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:49.288220 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:49.289205 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:49.324746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:49.586661 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:49.602135 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:49.609179 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:49.612279 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6b7d7a09-788a-4099-a9f3-c627a8492fbe tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.355801 Sep 12 23:30:49.615964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 218/435] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:49 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:30:49.885988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:30:49.886483 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:30:49.886952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:30:49.887358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:30:49.887822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:30:49.901806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:49.902629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:49.903350 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:49.904657 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:49.905615 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:49.906346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:49.926583 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for project adc049ff85c14935a9f68be76cd61c05. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:30:49.930880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Getting quotas for user 0248519bf5b54ce3ba3b40f2c9a4c628 and project adc049ff85c14935a9f68be76cd61c05. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:30:49.947474 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:30:49.951967 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:30:50.079411 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-317bf411-2dd6-4eaf-b196-a917c487e498 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.841340 Sep 12 23:30:50.087214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 218/436] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:30:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 2850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:30:50.104180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1f0333bc-fd81-47dc-a16f-632552fb4437 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:50.104180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1f0333bc-fd81-47dc-a16f-632552fb4437 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:50.234032 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1f0333bc-fd81-47dc-a16f-632552fb4437 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:50.241595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1f0333bc-fd81-47dc-a16f-632552fb4437 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1246 microversion: 2.1 time: 0.153661 Sep 12 23:30:50.256258 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 219/437] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:50 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1246 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:50.644380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:50.645246 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:50.657179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:50.657883 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:50.658505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:50.659594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:50.660289 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:50.660957 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:50.928268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:50.944785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:50.947273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:50.950038 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b3a31eaa-9369-4074-8e85-6eb803ca7f86 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.311173 Sep 12 23:30:50.951341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 219/438] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:50 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:51.271693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:51.273124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:51.280332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:51.281137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:51.281812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:51.282746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:51.283391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:51.284078 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:51.360585 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:51.373387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e454dc06-3147-40dc-bb29-f44a64385c7a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1298 microversion: 2.1 time: 0.105774 Sep 12 23:30:51.375561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 220/439] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:51 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:51.980077 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:51.981195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:51.999690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:52.000202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:52.000744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:52.004650 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:52.005462 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:52.008859 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:52.399758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:52.400649 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:52.409956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:52.421687 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:52.424810 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:52.425911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:52.426983 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4b2e6a49-e4de-42e4-8fa1-11209e34dbad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1740 microversion: 2.20 time: 0.451776 Sep 12 23:30:52.428104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 220/440] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:51 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:52.446693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:52.447712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:52.448728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:52.449402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:52.450032 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:52.629812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:52.637765 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7339c3d9-2297-43c3-b21b-9e781e44230c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1304 microversion: 2.1 time: 0.243478 Sep 12 23:30:52.638319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 221/441] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:52 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:53.455912 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:53.456798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:53.463489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:53.464335 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:53.464764 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:53.465451 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:53.471167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:53.472995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:53.661052 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:53.662298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:53.669459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:53.670256 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:53.670966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:53.671955 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:53.672702 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:53.673613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:53.747715 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:53.760947 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:53.762509 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:53.763747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9d1cc208-3586-4d5a-81ae-796046a864bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1722 microversion: 2.20 time: 0.312843 Sep 12 23:30:53.764622 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 221/442] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:53 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:53.897446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:53.906533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0fd2a26c-a516-4211-be0d-689e15c06477 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.249181 Sep 12 23:30:53.907851 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 222/443] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:53 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:54.323169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-f07696c1-e68f-4c32-9960-be0c65491e40 req-829c25c2-7445-44e0-b5a9-59d70b9b7a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8328773-645f-4acb-aad8-2984c3b13211", "tag": "d24cc5eb-346a-4639-811c-1a0c53b0e5cc"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:54.342295 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-f07696c1-e68f-4c32-9960-be0c65491e40 req-829c25c2-7445-44e0-b5a9-59d70b9b7a33 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:54.343024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-f07696c1-e68f-4c32-9960-be0c65491e40 req-829c25c2-7445-44e0-b5a9-59d70b9b7a33 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:54.343680 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-f07696c1-e68f-4c32-9960-be0c65491e40 req-829c25c2-7445-44e0-b5a9-59d70b9b7a33 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:54.356895 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-f07696c1-e68f-4c32-9960-be0c65491e40 req-829c25c2-7445-44e0-b5a9-59d70b9b7a33 service nova] Creating event network-changed:d24cc5eb-346a-4639-811c-1a0c53b0e5cc for instance b8328773-645f-4acb-aad8-2984c3b13211 on hv-cinder-85200 Sep 12 23:30:54.362283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-f07696c1-e68f-4c32-9960-be0c65491e40 req-829c25c2-7445-44e0-b5a9-59d70b9b7a33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043051 Sep 12 23:30:54.362947 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 222/444] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:30:54.790239 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:54.790842 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:54.797155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:54.797817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:54.798431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:54.801304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:54.801775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:54.802196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:54.931470 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:54.934117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:54.941662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:54.944448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:54.944685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:54.945643 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:54.946177 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:54.946675 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:54.961405 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:54.973481 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:54.975763 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:54.977559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-235e1437-beb8-4a95-835a-1d6bba3239e6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1722 microversion: 2.20 time: 0.190978 Sep 12 23:30:54.980998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 223/445] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:54 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:55.095077 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:55.105687 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-46e8eb0d-6a5c-40bc-8280-b8b40d42386c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.178501 Sep 12 23:30:55.109343 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 223/446] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:54 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:56.006564 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:56.007640 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:56.020422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:56.022077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:56.024002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:56.025041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:56.026253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:56.027384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:56.133943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:56.134740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:56.142281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:56.144752 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:56.145669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:56.146403 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:56.147121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:56.147598 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:56.148009 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:56.229483 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:56.246481 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:56.248766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:56.250194 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f09b270f-5229-436f-ad8a-a14662e97e52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1722 microversion: 2.20 time: 0.247920 Sep 12 23:30:56.250867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 224/447] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:56 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:56.365672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:56.373287 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5011463b-69db-4de7-854c-fcc303dea287 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.247775 Sep 12 23:30:56.374022 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 224/448] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:56 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:57.281655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:57.282844 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:57.288997 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:57.289479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:57.290351 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:57.291071 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:57.291506 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:57.291971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:57.399503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:57.402932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:57.421795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:57.424506 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:57.425516 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:57.429691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:57.430211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:57.430878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:57.505044 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:57.515771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:57.517201 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:57.518354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ebb5bae5-7c64-4429-97ac-9be6c17a2136 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1665 microversion: 2.20 time: 0.241777 Sep 12 23:30:57.519602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 225/449] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:57 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1665 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:57.544730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19087940-1948-4b5b-bd67-54c0567cae13"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:57.547126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:57.553576 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:57.554103 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:57.554743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:57.555479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:57.555961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:57.556384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:57.657991 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:57.676482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1264bb7a-f440-4955-b37b-cfa6d2b9778a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.280812 Sep 12 23:30:57.677487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 225/450] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:57 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:30:57.893671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cf2f137b-5335-423d-91a9-84220af626f6 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.350735 Sep 12 23:30:57.894689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 226/451] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Sep 12 23:30:57 2022] POST /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:30:57.956901 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-a0e21df3-5f33-4dd1-b893-036a979af7b5 req-b16fb3c3-493e-4bf2-a70c-9578a23f3050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d4dcb-1679-4627-b94b-adc34cfffbb3", "name": "network-vif-unplugged", "status": "completed", "tag": "fbdc10fe-ce53-41fd-a771-18e381482273"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:57.968182 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a0e21df3-5f33-4dd1-b893-036a979af7b5 req-b16fb3c3-493e-4bf2-a70c-9578a23f3050 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:57.968625 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a0e21df3-5f33-4dd1-b893-036a979af7b5 req-b16fb3c3-493e-4bf2-a70c-9578a23f3050 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:57.969057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a0e21df3-5f33-4dd1-b893-036a979af7b5 req-b16fb3c3-493e-4bf2-a70c-9578a23f3050 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:57.981410 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.compute.server_external_events [req-a0e21df3-5f33-4dd1-b893-036a979af7b5 req-b16fb3c3-493e-4bf2-a70c-9578a23f3050 service nova] Unable to find a host for instance e07d4dcb-1679-4627-b94b-adc34cfffbb3. Dropping event network-vif-unplugged {{(pid=120621) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 12 23:30:57.982288 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-a0e21df3-5f33-4dd1-b893-036a979af7b5 req-b16fb3c3-493e-4bf2-a70c-9578a23f3050 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029222 Sep 12 23:30:57.983203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 226/452] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 12 23:30:58.067253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:30:58.067897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:58.074438 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:58.075172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:58.075740 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:58.076955 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:58.077473 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:58.077898 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:58.121889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120622) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 23:30:58.194989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-863fdc77-2abd-41f9-b7e3-66d981b4b29f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/action" status: 202 len: 0 microversion: 2.20 time: 0.131113 Sep 12 23:30:58.199162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 227/453] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Sep 12 23:30:58 2022] POST /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:30:58.206316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:58.207092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:58.214807 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:58.215434 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:58.216065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:58.216908 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:58.217604 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:58.218258 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:58.383526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:58.397313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:58.399169 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:58.401166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8b8c0500-eb63-499b-ad97-a54a9319eff5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1751 microversion: 2.20 time: 0.199355 Sep 12 23:30:58.401986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 227/454] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:58 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:58.701393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:58.702574 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:58.708076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:30:58.710226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:58.711027 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:58.711696 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:58.712974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:58.713430 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:58.714679 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:58.888280 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:58.904985 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-552a0690-6481-404b-b2da-998926ff9b96 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.204381 Sep 12 23:30:58.905801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 228/455] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:58 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:30:59.428013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:59.428778 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:59.435230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:59.435808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:59.436268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:59.436999 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:59.437485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:59.437910 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:59.599725 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:59.612186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:59.625119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:30:59.626422 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c7a31085-3032-4ab0-8810-98cbb5bc0155 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1751 microversion: 2.20 time: 0.202273 Sep 12 23:30:59.626997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 228/456] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:30:59 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:30:59.930404 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:30:59.931089 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:30:59.938652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:59.939223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:59.939761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:30:59.940507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:30:59.941126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:30:59.941544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:00.094527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:00.103366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-63c37dbc-81a5-4ddd-b5d7-d2fa48850114 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.177082 Sep 12 23:31:00.103989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 229/457] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:30:59 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:00.661842 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:00.662597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:00.668807 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:00.670108 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:00.673201 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:00.673955 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:00.675234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:00.676041 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:00.680759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:00.681294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:00.839250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:00.855746 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:00.857199 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:00.858367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-70f81a54-82d6-41d2-8cec-04c3230c436e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.200479 Sep 12 23:31:00.858938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 229/458] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:00 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:01.130780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:01.131434 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:01.133237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:01.139541 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:01.140049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:01.140475 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:01.141158 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:01.141603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:01.142025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:01.311974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:01.320369 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c3fe2501-a78f-4008-a22b-b18f83ea6cc4 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.193367 Sep 12 23:31:01.327603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 230/459] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:01 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:01.891671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:01.891671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:01.905125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:01.905614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:01.906317 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:01.907402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:01.908307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:01.909020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:02.029133 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-2fb3ac5a-e045-44b5-aa3d-a5e899c23447 req-66b9d3df-959b-49b1-a287-0e1e85f6e44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8328773-645f-4acb-aad8-2984c3b13211", "name": "network-vif-plugged", "status": "completed", "tag": "d24cc5eb-346a-4639-811c-1a0c53b0e5cc"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:02.045973 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-2fb3ac5a-e045-44b5-aa3d-a5e899c23447 req-66b9d3df-959b-49b1-a287-0e1e85f6e44a service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:02.049482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-2fb3ac5a-e045-44b5-aa3d-a5e899c23447 req-66b9d3df-959b-49b1-a287-0e1e85f6e44a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:02.050126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-2fb3ac5a-e045-44b5-aa3d-a5e899c23447 req-66b9d3df-959b-49b1-a287-0e1e85f6e44a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:02.071415 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-2fb3ac5a-e045-44b5-aa3d-a5e899c23447 req-66b9d3df-959b-49b1-a287-0e1e85f6e44a service nova] Creating event network-vif-plugged:d24cc5eb-346a-4639-811c-1a0c53b0e5cc for instance b8328773-645f-4acb-aad8-2984c3b13211 on hv-cinder-85200 Sep 12 23:31:02.076687 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-2fb3ac5a-e045-44b5-aa3d-a5e899c23447 req-66b9d3df-959b-49b1-a287-0e1e85f6e44a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054384 Sep 12 23:31:02.077916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 231/460] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:31:02.140918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:02.153204 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:02.155074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:02.156567 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ade3a93b-6f50-498c-b7e1-18b56ac089a0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.271582 Sep 12 23:31:02.157121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 230/461] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:01 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:02.345954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:02.347267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:02.354621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:02.355390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:02.356118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:02.357052 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:02.357712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:02.358915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:02.567375 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:02.575601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2f643da4-7e75-4715-9dba-1efd395605ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.234190 Sep 12 23:31:02.581189 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 232/462] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:02 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:03.185014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:03.185613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:03.192514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:03.193067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:03.193723 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:03.194495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:03.194974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:03.195433 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:03.333454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:03.342570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:03.344067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:03.345313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-34ce2f49-5d60-4087-bf1e-96a62354a1b9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.164830 Sep 12 23:31:03.345950 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 231/463] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:03 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:03.598607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:03.599157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:03.605144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:03.605627 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:03.606062 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:03.606733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:03.607180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:03.607615 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:03.611874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:03.752620 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:03.761165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-92f98725-b5aa-41cd-b09b-62c975c59b75 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.166631 Sep 12 23:31:03.762265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 233/464] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:03 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:04.372510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:04.373128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:04.379846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:04.380352 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:04.380851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:04.381527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:04.382003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:04.382430 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:04.534581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:04.545614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:04.547042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:04.548234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-eb81598e-bf80-408c-88e7-4601950c6b0c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.180267 Sep 12 23:31:04.548779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 232/465] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:04 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:04.784595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:04.785117 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:04.791223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:04.791799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:04.793065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:04.793789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:04.794366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:04.794791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:04.928833 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:04.937310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2686aeea-21a5-4585-a9f3-d2927ef78951 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.156546 Sep 12 23:31:04.937897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 234/466] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:04 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:05.574405 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:05.575003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:05.582092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:05.583015 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:05.583858 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:05.584846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:05.585891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:05.586651 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:05.733655 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:05.737868 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:05.745514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:05.747014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:05.748279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-370a5a61-be6b-4e50-9da0-16ea87a90a1b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.177835 Sep 12 23:31:05.748828 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 233/467] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:05 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:05.962087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:05.964611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:05.971082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:05.971590 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:05.972035 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:05.972739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:05.973186 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:05.973605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:06.134509 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:06.143009 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-82fd693f-5c0e-42b5-a6a3-89fd1ffdc630 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.184950 Sep 12 23:31:06.143591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 235/468] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:05 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:06.776464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:06.777058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:06.785197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:06.785953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:06.786395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:06.787093 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:06.787787 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:06.788432 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:06.975959 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:06.986394 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:06.988567 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:06.989929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8a0ca506-a36d-4e4b-89a3-6880f306df73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.217508 Sep 12 23:31:06.990518 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 234/469] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:06 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:07.168571 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:07.169414 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:07.181432 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:07.182314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:07.182967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:07.184053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:07.184727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:07.185357 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:07.390031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:07.403807 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-51b919fd-fd73-484c-adb4-c35a3f52d062 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.240911 Sep 12 23:31:07.404893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 236/470] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:07 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:08.018676 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:08.019293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:08.035281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:08.036073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:08.036684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:08.037555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:08.038297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:08.038873 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:08.268830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:08.278926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:08.281048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:08.282471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-69af6c66-b4bf-449e-9e69-8195e894f1b0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.268382 Sep 12 23:31:08.283594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 235/471] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:08 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:08.428043 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:08.429885 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:08.439292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:08.440192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:08.441237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:08.442173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:08.442847 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:08.443467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:08.510880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1705286079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1903603689", "security_groups": [{"name": "tempest-secgroup-smoke-575282427"}], "block_device_mapping_v2": [{"uuid": "72d26c7f-4abc-474f-8344-2f06052f95d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eca586cf-58eb-48f2-bcf7-9aa793fb9bf1"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:08.685211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:08.698246 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-23797a2f-fcbf-4a4b-808f-9271315e69a5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.274176 Sep 12 23:31:08.702386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 237/472] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:08 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:08.703892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] validate_networks() for [('eca586cf-58eb-48f2-bcf7-9aa793fb9bf1', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:31:09.312360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:09.312920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:09.331500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:09.332130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:09.332571 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:09.333355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:09.333811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:09.334241 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:09.540924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:09.552443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:09.555082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:09.557942 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3913e948-2d4b-4d89-904c-ec6344b72906 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.249520 Sep 12 23:31:09.567100 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 238/473] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:09 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:09.593057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:31:09.594077 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:31:09.594920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:31:09.595836 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:31:09.596644 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:31:09.617904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:09.618782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:09.620146 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:09.620982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:09.621850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:09.622361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:09.657023 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for project eaa5d21fc40540e4b811713e5efeff46. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:31:09.676010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for user 2d62232282dc4455834857d5290eb169 and project eaa5d21fc40540e4b811713e5efeff46. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:31:09.722618 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:09.723377 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:09.731002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:09.731973 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:09.732659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:09.733685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:09.734534 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:09.735182 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:09.788367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:31:09.790916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d26c7f-4abc-474f-8344-2f06052f95d8',volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:31:10.017071 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2af0977e-eb3c-4d3d-9afe-58aad66a2efb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.509924 Sep 12 23:31:10.018421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 236/474] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:31:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:31:10.034297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c34ccf33-6e51-4938-8b6e-6554d72aadb7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:10.039884 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c34ccf33-6e51-4938-8b6e-6554d72aadb7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:10.045348 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:10.074693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6dd0a1d4-f49f-4309-afe6-724149d42bc2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.356063 Sep 12 23:31:10.076322 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 239/475] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:09 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:10.129542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c34ccf33-6e51-4938-8b6e-6554d72aadb7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:10.141772 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c34ccf33-6e51-4938-8b6e-6554d72aadb7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1095 microversion: 2.1 time: 0.116154 Sep 12 23:31:10.143116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 237/476] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:10 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1095 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:10.592336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:10.593958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:10.601862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:10.602873 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:10.603487 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:10.605180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:10.606215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:10.611771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:10.877802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:10.890513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:10.902693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:10.908049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-834f9a37-9268-4e5b-9c1d-5a81c18c9029 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.319340 Sep 12 23:31:10.921019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 240/477] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:10 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:11.102226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:11.102835 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:11.116306 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:11.116306 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:11.136553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:11.136553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:11.136553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:11.136553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:11.168679 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:11.169800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:11.177195 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:11.178104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:11.178762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:11.179752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:11.180538 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:11.181230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:11.259693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:11.270891 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ea0c55bd-a7e7-4340-b74f-72cdbc74a611 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1145 microversion: 2.1 time: 0.106918 Sep 12 23:31:11.271819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 241/478] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:11 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1145 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:11.427237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:11.435208 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-37f1c914-044f-4a8e-92c8-c0e2d3d56794 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.336707 Sep 12 23:31:11.435880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 238/479] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:11 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:11.940926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:11.942664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:11.948952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:11.949488 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:11.949924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:11.950614 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:11.951069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:11.951492 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:12.084183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:12.092939 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:12.094640 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:12.096065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-10bbfb1c-32e9-44f2-bd3b-b801cf6e47c7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.159302 Sep 12 23:31:12.097514 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 242/480] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:11 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:12.295295 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:12.295929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:12.313953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:12.314438 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:12.314881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:12.315627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:12.316084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:12.316799 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:12.400107 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:12.411090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-52f960c7-0e7d-4696-89a3-ef08a5bef1d5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1145 microversion: 2.1 time: 0.120220 Sep 12 23:31:12.411892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 239/481] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:12 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1145 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:12.458520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:12.459039 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:12.465575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:12.466058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:12.466692 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:12.467384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:12.467854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:12.468459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:12.701414 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:12.709439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d52d181a-a16c-436f-ae60-3334cc950011 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1371 microversion: 2.1 time: 0.254717 Sep 12 23:31:12.712091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 243/482] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:12 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:13.122920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:13.123824 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:13.131048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:13.132055 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:13.132705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:13.133646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:13.134495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:13.135862 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:13.435208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:13.435850 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:13.446511 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:13.451931 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:13.452854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:13.457561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:13.458452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:13.459094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:13.461074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:13.478546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:13.482969 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:13.484711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-61859c0c-7ff3-4108-b3d0-2fcc84da1063 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.366318 Sep 12 23:31:13.516190 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 240/483] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:13 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:13.581242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:13.590211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d3809378-ca1f-4672-a813-a7266fca41b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1137 microversion: 2.1 time: 0.159694 Sep 12 23:31:13.591501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 244/484] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:13 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1137 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:13.734750 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:13.735536 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:13.746576 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:13.748073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:13.749010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:13.751253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:13.752704 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:13.753731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:13.992051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:14.000315 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a9b1fc33-8f15-4145-b729-c9734d69c80c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1565 microversion: 2.1 time: 0.271711 Sep 12 23:31:14.001288 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 241/485] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:13 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1565 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:14.030629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:14.031145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:14.038002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:14.039138 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:14.039623 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:14.040350 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:14.040813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:14.041802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:14.241307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-581954b3-e695-4934-96af-fde838ea3db3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.214422 Sep 12 23:31:14.242464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 245/486] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:31:14 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:31:14.514402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:14.515921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:14.530654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:14.533784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:14.534597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:14.539407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:14.540219 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:14.540971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:14.620299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:14.623227 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:14.670874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:14.671692 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:14.672888 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:14.674190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:14.675210 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:14.675945 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:14.784714 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:14.794909 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9d872ead-fc0f-48d3-b1d1-9cbd72cf6152 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1211 microversion: 2.1 time: 0.184418 Sep 12 23:31:14.807592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 246/487] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:14 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1211 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:15.379844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:15.395147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:15.396867 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:15.401063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cc46c41f-32d7-49a9-9b36-26e9ef237000 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.891274 Sep 12 23:31:15.405437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 242/488] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:14 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:15.830005 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:15.833809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:15.854449 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:15.854938 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:15.855367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:15.856149 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:15.859498 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:15.859498 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:15.963756 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:15.977698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-24f068a7-895b-453f-a624-be9edabd37f0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1199 microversion: 2.1 time: 0.155062 Sep 12 23:31:15.979092 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 247/489] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:15 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1199 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:16.431359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:16.432089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:16.440502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:16.451851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:16.452579 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:16.453508 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:16.453967 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:16.454393 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:16.992540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-799f1956-a560-43b8-9dba-b05f04f0b004 req-487c8ea2-eb13-45ac-8491-0d22dd3295ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8328773-645f-4acb-aad8-2984c3b13211", "tag": "d24cc5eb-346a-4639-811c-1a0c53b0e5cc"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:17.031175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-799f1956-a560-43b8-9dba-b05f04f0b004 req-487c8ea2-eb13-45ac-8491-0d22dd3295ca service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:17.036170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-799f1956-a560-43b8-9dba-b05f04f0b004 req-487c8ea2-eb13-45ac-8491-0d22dd3295ca service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:17.037300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-799f1956-a560-43b8-9dba-b05f04f0b004 req-487c8ea2-eb13-45ac-8491-0d22dd3295ca service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:17.066914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-799f1956-a560-43b8-9dba-b05f04f0b004 req-487c8ea2-eb13-45ac-8491-0d22dd3295ca service nova] Creating event network-changed:d24cc5eb-346a-4639-811c-1a0c53b0e5cc for instance b8328773-645f-4acb-aad8-2984c3b13211 on hv-cinder-85200 Sep 12 23:31:17.091419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-799f1956-a560-43b8-9dba-b05f04f0b004 req-487c8ea2-eb13-45ac-8491-0d22dd3295ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102352 Sep 12 23:31:17.103597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:17.124241 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 248/490] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:31:17.132534 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:17.136763 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:17.137447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:17.139526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-daea6013-50b2-4e92-850a-a5bd9c95dbfb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.711789 Sep 12 23:31:17.141617 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:17.169925 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 243/491] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:16 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:17.175214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:17.175862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:17.176295 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:17.177398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:17.177930 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:17.178351 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:17.703224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:17.725383 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-61abfc20-d565-48af-ba76-c6cec247ba72 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.598983 Sep 12 23:31:17.727974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 249/492] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:17 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:18.175878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:18.177095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:18.188262 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:18.188978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:18.189787 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:18.191092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:18.195587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:18.196303 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:18.443095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:18.464089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:18.465743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:18.467176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-65dac8e2-ff01-44cb-8b2b-55f8c3cc4be5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.296022 Sep 12 23:31:18.484294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 244/493] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:18 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:18.750240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:18.751036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:18.757849 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:18.763744 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:18.764531 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:18.765656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:18.766353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:18.768825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:19.099155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:19.109544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:19.125370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3e64631f-3701-4a5e-9b43-eab3fb651efa tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.378990 Sep 12 23:31:19.127130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 250/494] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:18 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:19.145578 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-ede890b1-757a-48d4-a565-8421d4a6ae0d req-e409fa3f-24fc-45e3-9693-3994f4a43121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712d2ca0-8999-4499-854b-b80c8cff71cf", "tag": "5ac5e83f-2775-42c0-9cd0-314f2df0bbaa"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:19.156322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ede890b1-757a-48d4-a565-8421d4a6ae0d req-e409fa3f-24fc-45e3-9693-3994f4a43121 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:19.157143 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ede890b1-757a-48d4-a565-8421d4a6ae0d req-e409fa3f-24fc-45e3-9693-3994f4a43121 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:19.157822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ede890b1-757a-48d4-a565-8421d4a6ae0d req-e409fa3f-24fc-45e3-9693-3994f4a43121 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:19.170187 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-ede890b1-757a-48d4-a565-8421d4a6ae0d req-e409fa3f-24fc-45e3-9693-3994f4a43121 service nova] Creating event network-changed:5ac5e83f-2775-42c0-9cd0-314f2df0bbaa for instance 712d2ca0-8999-4499-854b-b80c8cff71cf on hv-cinder-85200 Sep 12 23:31:19.176366 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-ede890b1-757a-48d4-a565-8421d4a6ae0d req-e409fa3f-24fc-45e3-9693-3994f4a43121 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036998 Sep 12 23:31:19.178031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 245/495] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:31:19.498676 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:19.500076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:19.512589 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:19.513387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:19.513999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:19.514893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:19.515500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:19.516285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:19.704979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:19.714682 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:19.716626 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:19.718070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-978027c5-146f-44e6-89b3-6249e111e732 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.227336 Sep 12 23:31:19.720005 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 251/496] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:19 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:20.149505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:20.150936 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:20.152948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:20.154061 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:20.160955 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:20.161454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:20.162381 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:20.163094 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:20.163738 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:20.164170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:20.420291 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:20.428858 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b870db5d-19ef-4c45-8187-4fb77560f838 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.283608 Sep 12 23:31:20.429682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 246/497] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:20 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:20.747160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:20.748570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:20.757279 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:20.758126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:20.758835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:20.760729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:20.761447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:20.762168 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:20.923604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:20.935930 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:20.937714 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:20.938908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8e6e1d44-7d95-44cd-8324-33095e342291 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.197278 Sep 12 23:31:20.939467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 252/498] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:20 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:21.452265 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:21.452865 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:21.461798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:21.462518 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:21.463735 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:21.464767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:21.465458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:21.466133 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:21.692564 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:21.703216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3ecbeef1-d8e9-4cf3-bdc7-050ecf67dd39 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.254807 Sep 12 23:31:21.708354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 247/499] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:21 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:21.971117 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:21.973356 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:21.980974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:21.981725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:21.982366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:21.983465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:21.984223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:21.984640 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:22.232132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:22.243214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:22.245198 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:22.247412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3451ff59-5b48-42ba-9c56-9c9ebf9bec21 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.284820 Sep 12 23:31:22.248956 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 253/500] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:21 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:22.560117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8d81e262-f9b7-4b1c-8aa4-a6abcdd8a518 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Action: 'create', calling method: .version_select at 0x7fa4b38464c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1045113572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4FqMVaCpQuZZAK17xuRjY/4pUR28q70yDcbBckdn1Khksh1oCxd1RrorEFwTIiNAcrYNpUo0xxYIjWq6VHHX7EvvLVN4ZrtnyiZP2+A98qk/6Qg6BvL5d1gafs2aGPOg=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:22.576428 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-8d81e262-f9b7-4b1c-8aa4-a6abcdd8a518 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Getting quotas for project e3ac3aed7b1e495f81dc29d224be1eba. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:31:22.583589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-8d81e262-f9b7-4b1c-8aa4-a6abcdd8a518 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Getting quotas for user 2e22d2226f77454fb3f155dbf3fdf471 and project e3ac3aed7b1e495f81dc29d224be1eba. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:31:22.613433 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8d81e262-f9b7-4b1c-8aa4-a6abcdd8a518 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.245532 Sep 12 23:31:22.614036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 248/501] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:31:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:31:22.727502 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:22.728170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:22.736908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:22.737672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:22.738419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:22.739800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:22.740118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:22.740542 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:22.917132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:22.929370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-643bdbc9-0afb-482a-8a9a-8ec7bcd57f9a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.206390 Sep 12 23:31:22.942570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 254/502] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:22 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:23.276932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:23.277538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:23.284750 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:23.285451 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:23.286099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:23.286932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:23.287487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:23.287938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:23.428063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:23.438688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:23.440697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:23.441978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cd2b732e-dedd-4844-ba90-a79f91ca04c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.169414 Sep 12 23:31:23.447864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 249/503] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:23 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:23.953639 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:23.954241 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:23.964990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:23.965527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:23.969200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:23.969959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:23.970425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:23.970860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:24.131117 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:24.143620 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bc90cd8a-534d-4be8-bba8-ca1f66ececb6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.193123 Sep 12 23:31:24.160892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 255/504] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:23 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:24.213909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-4969e0ce-2bc6-4524-bb1c-85c7f8554e65 req-92f76696-bda7-48c6-9d91-798afccfc4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d4dcb-1679-4627-b94b-adc34cfffbb3", "name": "network-vif-plugged", "status": "completed", "tag": "fbdc10fe-ce53-41fd-a771-18e381482273"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:24.225172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-4969e0ce-2bc6-4524-bb1c-85c7f8554e65 req-92f76696-bda7-48c6-9d91-798afccfc4eb service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:24.225661 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-4969e0ce-2bc6-4524-bb1c-85c7f8554e65 req-92f76696-bda7-48c6-9d91-798afccfc4eb service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:24.226114 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-4969e0ce-2bc6-4524-bb1c-85c7f8554e65 req-92f76696-bda7-48c6-9d91-798afccfc4eb service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:24.238309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-4969e0ce-2bc6-4524-bb1c-85c7f8554e65 req-92f76696-bda7-48c6-9d91-798afccfc4eb service nova] Creating event network-vif-plugged:fbdc10fe-ce53-41fd-a771-18e381482273 for instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 on hv-cinder-85200 Sep 12 23:31:24.243680 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-4969e0ce-2bc6-4524-bb1c-85c7f8554e65 req-92f76696-bda7-48c6-9d91-798afccfc4eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Sep 12 23:31:24.244929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 250/505] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:31:24.468289 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:24.468998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:24.475307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:24.475827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:24.476506 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:24.477400 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:24.478111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:24.478613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:24.626708 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:24.639037 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:24.641020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:24.642485 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-67028bcf-a6bf-4cea-a38c-d1854a24e673 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.178875 Sep 12 23:31:24.643045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 256/506] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:24 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:25.166661 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:25.167354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:25.173492 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:25.173973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:25.174406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:25.175083 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:25.175530 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:25.175977 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:25.335320 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:25.344287 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0219ed06-dcbb-454a-a981-cedc674f3b85 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.181633 Sep 12 23:31:25.344872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 251/507] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:25 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:25.669117 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:25.669809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:25.676228 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:25.676706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:25.677136 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:25.677814 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:25.678256 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:25.678675 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:25.813650 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:25.822152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:25.823607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:25.824760 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-165ec9c4-e6c8-455d-8b3a-ca1250cef521 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.160356 Sep 12 23:31:25.825314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 257/508] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:25 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:26.366482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:26.367084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:26.370090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:26.375721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:26.376210 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:26.376642 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:26.377344 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:26.377791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:26.378207 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:26.531290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:26.543309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-77c2e6b2-0bbd-4494-8503-5be7fb4e377d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.180641 Sep 12 23:31:26.546143 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 252/509] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:26 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:26.851040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:26.851656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:26.858302 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:26.858782 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:26.859213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:26.860037 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:26.860486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:26.860902 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:26.993849 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:27.002183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:27.003638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:27.004786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1eea93ab-5871-4b77-81d4-1cedca7b64d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.157822 Sep 12 23:31:27.005341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 258/510] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:26 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:27.566263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:27.566946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:27.575530 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:27.576046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:27.576702 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:27.577525 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:27.577987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:27.578416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:27.718242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:27.726798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6dc6c4cc-03e8-4855-92bd-42da3889a0fb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.164537 Sep 12 23:31:27.743833 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 253/511] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:27 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:28.032691 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:28.033811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:28.044188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:28.044680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:28.045110 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:28.045806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:28.046251 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:28.046664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:28.192636 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:28.203138 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:28.207781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:28.209678 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-19c9e418-3273-4c7b-a882-e7484a4500bd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1809 microversion: 2.20 time: 0.181735 Sep 12 23:31:28.210435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 259/512] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:28 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:28.749743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:28.750392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:28.756928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:28.757408 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:28.757871 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:28.758808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:28.759264 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:28.759717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:28.777773 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:28.897439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:28.905730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-27c9e759-7d69-43f1-9d9c-e7ce8b2e3f71 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.159774 Sep 12 23:31:28.906314 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 254/513] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:28 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:29.236181 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:29.236778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:29.238607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=64 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:29.244069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:29.244545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:29.244971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:29.245666 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:29.246114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:29.246529 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:29.375413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:29.383786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:29.385739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:29.386879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bfd20bc1-f6a7-4380-8dc3-70c99653dcd7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1796 microversion: 2.20 time: 0.154754 Sep 12 23:31:29.387940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 260/514] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:31:29 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1796 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:31:29.928876 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:29.930056 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:29.937336 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:29.937816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:29.938248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:29.938934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:29.939375 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:29.939823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:30.074356 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:30.082548 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f2a4d091-c044-4068-95d5-33daed7fbcfb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.157374 Sep 12 23:31:30.083120 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 255/515] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:29 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:30.129215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-08f1c573-db15-4523-bcac-f95818a1745f req-3698d062-037c-45a5-a042-23dc2b20a4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712d2ca0-8999-4499-854b-b80c8cff71cf", "name": "network-vif-plugged", "status": "completed", "tag": "5ac5e83f-2775-42c0-9cd0-314f2df0bbaa"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:30.140030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-08f1c573-db15-4523-bcac-f95818a1745f req-3698d062-037c-45a5-a042-23dc2b20a4a7 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:30.140528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-08f1c573-db15-4523-bcac-f95818a1745f req-3698d062-037c-45a5-a042-23dc2b20a4a7 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:30.141154 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-08f1c573-db15-4523-bcac-f95818a1745f req-3698d062-037c-45a5-a042-23dc2b20a4a7 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:30.153638 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-08f1c573-db15-4523-bcac-f95818a1745f req-3698d062-037c-45a5-a042-23dc2b20a4a7 service nova] Creating event network-vif-plugged:5ac5e83f-2775-42c0-9cd0-314f2df0bbaa for instance 712d2ca0-8999-4499-854b-b80c8cff71cf on hv-cinder-85200 Sep 12 23:31:30.158601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-08f1c573-db15-4523-bcac-f95818a1745f req-3698d062-037c-45a5-a042-23dc2b20a4a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033055 Sep 12 23:31:30.159199 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 261/516] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:31:31.106075 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:31.106595 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:31.112946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:31.113418 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:31.113844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:31.114512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:31.114953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:31.115366 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:31.251199 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:31.258821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-886c3bdd-feb8-46df-bc6c-809f728d97a2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1266 microversion: 2.1 time: 0.157224 Sep 12 23:31:31.259426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 256/517] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:31 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:32.283253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:32.284000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:32.290048 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:32.290528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:32.290967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:32.291677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:32.292244 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:32.292695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:32.428051 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:32.436311 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-71722ca6-734a-48cf-8172-5964e85be4d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1453 microversion: 2.1 time: 0.157499 Sep 12 23:31:32.436870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 262/518] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:32 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:32.458423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:32.458929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:32.465226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:32.465717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:32.466145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:32.466853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:32.467322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:32.467755 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:32.593989 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:32.602428 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:32.610578 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-530024ee-a4a7-4038-9e1f-a5accb075d60 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1453 microversion: 2.1 time: 0.155967 Sep 12 23:31:32.611259 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 257/519] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:32 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:34.367591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-5319b808-3847-4855-9253-80160ef2885e req-74f0a528-8823-4035-b263-d35ac7735356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712d2ca0-8999-4499-854b-b80c8cff71cf", "tag": "5ac5e83f-2775-42c0-9cd0-314f2df0bbaa"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:34.376804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5319b808-3847-4855-9253-80160ef2885e req-74f0a528-8823-4035-b263-d35ac7735356 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:34.377290 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5319b808-3847-4855-9253-80160ef2885e req-74f0a528-8823-4035-b263-d35ac7735356 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:34.377724 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5319b808-3847-4855-9253-80160ef2885e req-74f0a528-8823-4035-b263-d35ac7735356 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:34.389366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-5319b808-3847-4855-9253-80160ef2885e req-74f0a528-8823-4035-b263-d35ac7735356 service nova] Creating event network-changed:5ac5e83f-2775-42c0-9cd0-314f2df0bbaa for instance 712d2ca0-8999-4499-854b-b80c8cff71cf on hv-cinder-85200 Sep 12 23:31:34.394687 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-5319b808-3847-4855-9253-80160ef2885e req-74f0a528-8823-4035-b263-d35ac7735356 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030672 Sep 12 23:31:34.395315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 263/520] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:31:37.492194 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:37.492688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:37.499334 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:37.499869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:37.500303 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:37.500987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:37.501442 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:37.501867 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:37.623452 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lazy-loading 'services' on Instance uuid bbaafcd0-103d-4e1a-a15e-fc8997acceef {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:31:37.734165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e1a3cdd6-b236-4615-acca-3d732361b4c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-volume_attachments/d8cc1c12-c556-4a5a-a272-99d3cbc85ac6" status: 202 len: 0 microversion: 2.1 time: 0.245642 Sep 12 23:31:37.734690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 258/521] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:31:37 2022] DELETE /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-volume_attachments/d8cc1c12-c556-4a5a-a272-99d3cbc85ac6 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:31:38.867151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-097a5435-8a64-4096-982e-671f8c70b9ef tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:38.873780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-097a5435-8a64-4096-982e-671f8c70b9ef tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:38.874255 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-097a5435-8a64-4096-982e-671f8c70b9ef tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:38.874710 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-097a5435-8a64-4096-982e-671f8c70b9ef tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:38.896635 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-097a5435-8a64-4096-982e-671f8c70b9ef tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Going to try to stop instance {{(pid=120622) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 23:31:38.938578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-097a5435-8a64-4096-982e-671f8c70b9ef tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action" status: 202 len: 0 microversion: 2.1 time: 0.075692 Sep 12 23:31:38.939186 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 264/522] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:31:38 2022] POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:31:38.948391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:38.949088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:38.956099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:38.956426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:38.956868 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:38.957565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:38.958350 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:38.958485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:39.097599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:39.105378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-81624284-b452-407b-99f8-b0664c79f0b1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.161783 Sep 12 23:31:39.105941 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 259/523] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:38 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:40.048368 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-179784751", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1045113572", "security_groups": [{"name": "tempest-secgroup-smoke-1683360433"}], "networks": [{"uuid": "a7ffe834-d031-4407-b7a2-432ed18b27d2"}], "block_device_mapping_v2": [{"uuid": "2df5f2c2-f6d8-4fba-b1b5-d012eb6628ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:40.128623 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:40.129227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:40.136099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:40.136584 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:40.137021 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:40.137712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:40.138165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:40.138587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:40.162756 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] validate_networks() for [('a7ffe834-d031-4407-b7a2-432ed18b27d2', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:31:40.268871 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:40.277102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-583fabfd-8370-49c5-b6c6-2f73e5e209c9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.152284 Sep 12 23:31:40.277664 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 260/524] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:40 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:40.556882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:31:40.557306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:31:40.557775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:31:40.558181 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:31:40.558586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:31:40.567281 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:40.567791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:40.568225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:40.568940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:40.569398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:40.569818 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:40.586614 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Getting quotas for project e3ac3aed7b1e495f81dc29d224be1eba. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:31:40.590715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Getting quotas for user 2e22d2226f77454fb3f155dbf3fdf471 and project e3ac3aed7b1e495f81dc29d224be1eba. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:31:40.647989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:31:40.650303 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2df5f2c2-f6d8-4fba-b1b5-d012eb6628ea',volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:31:40.778668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5a38ba58-2b77-47b9-8bf6-99ff5d23efb1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734399 Sep 12 23:31:40.779265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 265/525] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:31:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:31:40.791036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-91692a65-b9b4-4eaa-b6e3-aebfb9535849 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:40.791666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-91692a65-b9b4-4eaa-b6e3-aebfb9535849 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:40.848276 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-91692a65-b9b4-4eaa-b6e3-aebfb9535849 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:40.855948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-91692a65-b9b4-4eaa-b6e3-aebfb9535849 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1088 microversion: 2.1 time: 0.069394 Sep 12 23:31:40.856515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 261/526] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:40 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:41.302392 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:41.303932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:41.312410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:41.313140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:41.313577 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:41.314274 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:41.315376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:41.315910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:41.454153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:41.463796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-14c3ca9a-0c6f-416e-8042-61e0a8b74c62 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.164956 Sep 12 23:31:41.464401 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 266/527] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:41 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:41.878427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:41.878958 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:41.889772 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:41.890256 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:41.890688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:41.891379 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:41.891931 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:41.892359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:41.956707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:41.965500 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6637f2ce-cc77-4304-83be-305ee68481b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1186 microversion: 2.1 time: 0.090981 Sep 12 23:31:41.966062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 262/528] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:41 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:42.488578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:42.489287 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:42.496074 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:42.496559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:42.496990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:42.497674 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:42.498124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:42.498540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:42.640969 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:42.649544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0f231bf4-e67a-4531-94a4-23f9bed618d0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.164571 Sep 12 23:31:42.650381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 267/529] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:42 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:42.990007 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:42.990616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:42.997307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:42.997792 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:42.998230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:42.998917 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:42.999369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:42.999820 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:43.215774 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:43.223228 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e9f4c6ed-1d24-4568-b582-125678213360 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.237029 Sep 12 23:31:43.223824 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 263/530] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:42 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:43.573144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-dbdbe2db-f5ec-4a43-8f2f-f0e81ec31881 req-ecc095f7-22c1-4a03-b428-2f9298fa22cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0ad905-fb81-48ab-9712-10d8badbd7f6", "tag": "6ccc2d74-2c48-49e0-b714-f319925458f8"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:43.585541 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-dbdbe2db-f5ec-4a43-8f2f-f0e81ec31881 req-ecc095f7-22c1-4a03-b428-2f9298fa22cc service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:43.586028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-dbdbe2db-f5ec-4a43-8f2f-f0e81ec31881 req-ecc095f7-22c1-4a03-b428-2f9298fa22cc service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:43.586527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-dbdbe2db-f5ec-4a43-8f2f-f0e81ec31881 req-ecc095f7-22c1-4a03-b428-2f9298fa22cc service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:43.600822 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-dbdbe2db-f5ec-4a43-8f2f-f0e81ec31881 req-ecc095f7-22c1-4a03-b428-2f9298fa22cc service nova] Creating event network-changed:6ccc2d74-2c48-49e0-b714-f319925458f8 for instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 on hv-cinder-85200 Sep 12 23:31:43.605445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-dbdbe2db-f5ec-4a43-8f2f-f0e81ec31881 req-ecc095f7-22c1-4a03-b428-2f9298fa22cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036548 Sep 12 23:31:43.606050 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 268/531] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:31:43.675246 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:43.676218 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:43.683123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:43.683625 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:43.684060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:43.684749 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:43.685194 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:43.685644 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:43.897834 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:43.907043 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ab3d0f81-b955-4401-b482-dfd2d0041e97 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.236187 Sep 12 23:31:43.907633 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 264/532] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:43 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:44.247412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:44.248123 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:44.259477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:44.260047 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:44.260480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:44.261183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:44.261625 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:44.262040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:44.266168 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:44.394830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:44.404145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dac212bc-87a1-4d91-88c7-f4aaa2345b2d tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.161295 Sep 12 23:31:44.404848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 269/533] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:44 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:44.930832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:44.931374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:44.937894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:44.938372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:44.938801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:44.939482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:44.939956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:44.940368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:45.142363 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:45.150539 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-686b2c45-ea0e-47f2-be3e-fa80cd978cee tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.224142 Sep 12 23:31:45.151099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 265/534] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:44 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:45.426178 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:45.426779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:45.433306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:45.433780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:45.434207 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:45.434878 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:45.435327 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:45.435771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:45.571744 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:45.579229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-940edf8a-d16d-4ab3-b095-805f93917922 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.156884 Sep 12 23:31:45.579824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 270/535] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:45 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:46.178218 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:46.179106 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:46.185902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:46.186387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:46.186819 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:46.187503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:46.187986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:46.188409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:46.320037 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:46.328423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-47d8d2dc-e16a-4988-b7f2-9fb7aad2d181 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.154088 Sep 12 23:31:46.328983 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 266/536] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:46 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:46.602234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:46.602755 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:46.608804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:46.609282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:46.609711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:46.610384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:46.610835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:46.611267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:46.740306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:46.748819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-71cb8b21-5762-4025-a4ba-defa86004aca tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.150437 Sep 12 23:31:46.749396 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 271/537] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:46 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:47.353020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:47.353565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:47.359935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:47.360447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:47.360983 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:47.361974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:47.362832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:47.363385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:47.498678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:47.506304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6a683972-ded2-4aab-87d8-23eae89bf66d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.157536 Sep 12 23:31:47.506864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 267/538] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:47 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:47.771831 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:47.772437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:47.779297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:47.779855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:47.780293 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:47.780971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:47.781421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:47.781839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:47.911672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:47.919501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c7d31ed4-ca9b-4a1a-b114-f3b6a01fb8bd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.151432 Sep 12 23:31:47.920028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 272/539] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:47 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:48.530485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:48.531012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:48.537794 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:48.538378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:48.539035 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:48.540071 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:48.540715 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:48.541390 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:48.676124 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:48.684830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-adee215d-51b9-4568-a26e-7c1697a442ce tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1677 microversion: 2.1 time: 0.158460 Sep 12 23:31:48.685597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 268/540] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:48 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:48.942366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:48.943144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:48.949493 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:48.949978 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:48.950410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:48.951093 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:48.951545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:48.951992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:49.080336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:49.087947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a325fd6b-0b73-49cb-ae13-da35a3287000 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.149461 Sep 12 23:31:49.088515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 273/541] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:48 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:49.709854 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:49.710464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:49.716926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:49.717402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:49.717832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:49.718510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:49.718958 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:49.719375 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:49.850531 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:49.858634 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ff3eba0e-6340-4400-8c6e-494321f6a8a7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1654 microversion: 2.1 time: 0.152706 Sep 12 23:31:49.859186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 269/542] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:49 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:49.881850 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0a0c0b63-e0af-445f-b9b2-77aa07776360 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:49.887844 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0c0b63-e0af-445f-b9b2-77aa07776360 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:49.888324 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0c0b63-e0af-445f-b9b2-77aa07776360 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:49.888756 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0c0b63-e0af-445f-b9b2-77aa07776360 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:49.911272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0a0c0b63-e0af-445f-b9b2-77aa07776360 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Going to try to start instance {{(pid=120622) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 23:31:49.953407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0a0c0b63-e0af-445f-b9b2-77aa07776360 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action" status: 202 len: 0 microversion: 2.1 time: 0.075316 Sep 12 23:31:49.954009 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 274/543] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:31:49 2022] POST /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:31:49.961996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:49.962537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:49.968294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:49.968766 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:49.969191 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:49.969861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:49.970302 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:49.970714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:50.095540 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:50.103520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e1b8fc59-acf3-488b-8c9e-e59c0fef5acf tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1663 microversion: 2.1 time: 0.145362 Sep 12 23:31:50.104102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 270/544] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:49 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1663 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:50.113990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:50.114765 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:50.121637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:50.122118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:50.122588 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:50.123256 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:50.123732 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:50.124155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:50.251433 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:50.259616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3fb234df-c104-4fdc-9a6a-0ece9095bccd tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.149814 Sep 12 23:31:50.260190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 275/545] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:50 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:51.126227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:51.126731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:51.129172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:51.135300 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:51.135590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:51.136178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:51.136994 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:51.137444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:51.137861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:51.155431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:51.270869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:51.278875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-db2af24f-2c7e-4125-a026-5c95c3d7f014 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1663 microversion: 2.1 time: 0.156438 Sep 12 23:31:51.279631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 271/546] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:51 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:51.283977 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:51.284657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:51.287652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:51.288432 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:51.293548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:51.294040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:51.294473 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:51.295160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:51.295637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:51.296065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:51.426862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:51.435473 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b3654bff-9145-4fe7-b0d3-3e82e71615cf tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.155530 Sep 12 23:31:51.436077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 276/547] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:51 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:31:52.302587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:52.303194 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:52.309622 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:52.310085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:52.310515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:52.311192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:52.311666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:52.312089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:52.438631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:52.446832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6bd62563-d10c-4534-a08b-a0eea48fac18 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1667 microversion: 2.1 time: 0.148038 Sep 12 23:31:52.447391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 272/548] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:52 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1667 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:52.458183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:52.458789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:52.464801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:52.465282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:52.465717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:52.466399 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:52.466848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:52.467269 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:52.601721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:52.609360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-31f4011d-c4ff-40f0-be56-1d844fba0f26 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.155285 Sep 12 23:31:52.610206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 277/549] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:52 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:53.634888 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:53.635427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:53.642298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:53.642771 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:53.643196 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:53.643911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:53.644358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:53.644772 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:53.776580 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:53.784481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a1ec1a1a-bb6d-444f-9fd4-aadd81c6d328 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.156034 Sep 12 23:31:53.785028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 273/550] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:53 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:54.192100 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-04245c75-6ae3-420e-be52-331f4006084f req-282808ec-a8bb-4904-904f-387734a1e5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ad905-fb81-48ab-9712-10d8badbd7f6", "name": "network-vif-plugged", "status": "completed", "tag": "6ccc2d74-2c48-49e0-b714-f319925458f8"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:54.202101 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-04245c75-6ae3-420e-be52-331f4006084f req-282808ec-a8bb-4904-904f-387734a1e5e0 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:54.202571 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-04245c75-6ae3-420e-be52-331f4006084f req-282808ec-a8bb-4904-904f-387734a1e5e0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:54.203009 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-04245c75-6ae3-420e-be52-331f4006084f req-282808ec-a8bb-4904-904f-387734a1e5e0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:54.214019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-04245c75-6ae3-420e-be52-331f4006084f req-282808ec-a8bb-4904-904f-387734a1e5e0 service nova] Creating event network-vif-plugged:6ccc2d74-2c48-49e0-b714-f319925458f8 for instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 on hv-cinder-85200 Sep 12 23:31:54.218708 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-04245c75-6ae3-420e-be52-331f4006084f req-282808ec-a8bb-4904-904f-387734a1e5e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030304 Sep 12 23:31:54.219312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 278/551] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:31:54.806293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:54.806869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:54.813163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:54.813644 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:54.814074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:54.814779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:54.815225 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:54.815670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:54.952273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:54.959715 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-495166b1-baf0-4278-b9a6-43000322d911 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.157303 Sep 12 23:31:54.960272 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 274/552] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:54 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:55.983228 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:55.983940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:55.989990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:55.990490 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:55.990917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:55.991617 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:55.992687 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:55.993117 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:56.124700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:56.132300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ceae4f01-cc09-465a-b907-a82d7bc035fc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1260 microversion: 2.1 time: 0.153268 Sep 12 23:31:56.132880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 279/553] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:55 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:57.155404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:57.156052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:57.158321 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=48 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:31:57.163614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:57.164711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:57.165159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:57.165814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:57.166260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:57.166676 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:57.300580 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:57.309476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0e23a210-4add-4fb4-acbe-89e3fae7e13f tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1445 microversion: 2.1 time: 0.158133 Sep 12 23:31:57.310047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 275/554] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:57 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:57.332576 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:31:57.333190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:31:57.339809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:57.340297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:57.340729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:57.341417 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:57.341867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:57.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:57.469745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:31:57.477823 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-908f542f-a292-4545-a461-4dd1aca867c8 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1445 microversion: 2.1 time: 0.148974 Sep 12 23:31:57.478477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 280/555] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:31:57 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1445 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:31:59.074125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-eb8cd9bf-1220-486c-a1bb-64f319c39c8d req-d9df47f2-b214-4d43-a8e6-7558f747190e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0ad905-fb81-48ab-9712-10d8badbd7f6", "tag": "6ccc2d74-2c48-49e0-b714-f319925458f8"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:31:59.083845 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-eb8cd9bf-1220-486c-a1bb-64f319c39c8d req-d9df47f2-b214-4d43-a8e6-7558f747190e service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:31:59.084316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-eb8cd9bf-1220-486c-a1bb-64f319c39c8d req-d9df47f2-b214-4d43-a8e6-7558f747190e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:31:59.084734 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-eb8cd9bf-1220-486c-a1bb-64f319c39c8d req-d9df47f2-b214-4d43-a8e6-7558f747190e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:31:59.095955 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-eb8cd9bf-1220-486c-a1bb-64f319c39c8d req-d9df47f2-b214-4d43-a8e6-7558f747190e service nova] Creating event network-changed:6ccc2d74-2c48-49e0-b714-f319925458f8 for instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 on hv-cinder-85200 Sep 12 23:31:59.100968 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-eb8cd9bf-1220-486c-a1bb-64f319c39c8d req-d9df47f2-b214-4d43-a8e6-7558f747190e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030444 Sep 12 23:31:59.102094 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 276/556] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:01.465965 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9727947-4ff3-4926-aa95-b98879a4c61d"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:01.468439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:01.470641 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:01.475904 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:01.476384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:01.476816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:01.477490 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:01.477938 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:01.478359 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:01.730357 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cf7023f5-69fb-4df9-aaed-f83cec703994 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268288 Sep 12 23:32:01.730956 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 281/557] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:32:01 2022] POST /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:09.258143 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:09.259560 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=28 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:09.263841 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:09.266270 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:09.275919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:09.276796 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:09.277706 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:09.278407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:09.278872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:09.279301 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:09.301701 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lazy-loading 'flavor' on Instance uuid b8328773-645f-4acb-aad8-2984c3b13211 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:32:09.422048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6c8a14f1-8ee1-46ab-bd6b-2d5bfbef7029 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/action" status: 200 len: 32 microversion: 2.1 time: 0.165405 Sep 12 23:32:09.422668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 277/558] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:32:09 2022] POST /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:32:09.434345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:09.434810 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:09.441255 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:09.441781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:09.442509 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:09.443198 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:09.443798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:09.444180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:09.574472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:09.582586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7d0bcd4d-e747-4987-9d55-113cd80eb5a1 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.154174 Sep 12 23:32:09.583161 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 282/559] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:09 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:10.607362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:10.608044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:10.614063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:10.614542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:10.614974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:10.615678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:10.616133 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:10.616560 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:10.741826 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:10.749741 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fea71acd-eafe-4769-81aa-735ffec596f3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.147679 Sep 12 23:32:10.750304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 278/560] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:10 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:11.773572 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:11.774794 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:11.781998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:11.782484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:11.782914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:11.783613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:11.784091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:11.784520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:11.917445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:11.926843 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ac6eccf8-3a83-4060-ace1-a41a8544da23 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.157060 Sep 12 23:32:11.927428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 283/561] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:11 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:12.072646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:12.073165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:12.079451 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.079971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.080409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:12.081098 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.081551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.081973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:12.110932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-45b9e40e-2a32-4e79-bc50-36e1df52c1ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments/19087940-1948-4b5b-bd67-54c0567cae13" status: 200 len: 194 microversion: 2.20 time: 0.042422 Sep 12 23:32:12.111505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 279/562] 10.222.0.27 () {60 vars in 1454 bytes} [Mon Sep 12 23:32:12 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments/19087940-1948-4b5b-bd67-54c0567cae13 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:32:12.179424 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:12.179956 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:12.185949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.186430 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.186865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:12.187550 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.188028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.188456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:12.216762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:12.318494 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lazy-loading 'services' on Instance uuid e07d4dcb-1679-4627-b94b-adc34cfffbb3 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:32:12.428548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3f8d848a-103e-4696-be7a-69b05df7bf1e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments/19087940-1948-4b5b-bd67-54c0567cae13" status: 202 len: 0 microversion: 2.20 time: 0.252914 Sep 12 23:32:12.429126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 284/563] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Sep 12 23:32:12 2022] DELETE /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments/19087940-1948-4b5b-bd67-54c0567cae13 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:32:12.438032 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:12.440193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:12.446177 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.446682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.447113 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:12.447835 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.448304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.448894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:12.482072 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-83b8ce1a-e87e-4489-bcae-f21ca4738057 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047858 Sep 12 23:32:12.483005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 280/564] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Sep 12 23:32:12 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:32:12.951328 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:12.952069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:12.958221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.958733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.959166 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:12.959881 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:12.960329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:12.960747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:13.093712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:13.101958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-16976bf3-0fd1-418e-8a3d-c143c84e0671 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.155347 Sep 12 23:32:13.102543 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 285/565] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:12 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:13.495079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:13.497229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:13.503433 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:13.503941 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:13.504368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:13.505038 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:13.505479 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:13.505891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:13.534183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b75e51c5-4eae-490e-9272-f5309908eb43 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043082 Sep 12 23:32:13.534647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 281/566] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Sep 12 23:32:13 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:13.595914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:13.596407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:13.603243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:13.603823 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:13.604351 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:13.605131 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:13.605554 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:13.605972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:13.630090 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:32:13.702954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-664fa0d3-5435-4c93-9df5-59515cf40071 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 204 len: 0 microversion: 2.20 time: 0.110564 Sep 12 23:32:13.703600 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 286/567] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Sep 12 23:32:13 2022] DELETE /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 23:32:13.712928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:13.713541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:13.719387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:13.719909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:13.720344 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:13.721024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:13.721475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:13.721894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:13.852894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:13.860958 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:13.862398 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:13.863551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4fd24eae-1f32-4324-8bf8-f91e5cf5c86a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.155331 Sep 12 23:32:13.864135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 282/568] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:13 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:14.126098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:14.126716 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:14.132616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:14.133100 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:14.133535 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:14.134875 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:14.135326 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:14.135781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:14.265180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:14.273248 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d43ebeaa-3ddd-47ea-b9b2-ceab9dad4073 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.151419 Sep 12 23:32:14.273815 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 287/569] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:14 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:14.888073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:14.888677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:14.895187 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:14.895712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:14.896150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:14.896833 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:14.897290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:14.897712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:15.023324 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:15.032060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:15.033502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:15.034650 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-573b78d0-7ecd-4ae5-913a-81d182d20752 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.150438 Sep 12 23:32:15.035217 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 283/570] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:14 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:15.296475 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:15.297076 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:15.303347 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:15.303852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:15.304283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:15.304955 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:15.305401 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:15.305819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:15.430659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:15.438752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1190ccc4-f212-4a25-a179-95e280e45aa6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.146094 Sep 12 23:32:15.439311 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 288/571] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:15 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:16.065336 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:16.065869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:16.072526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:16.073657 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:16.074183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:16.074943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:16.075643 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:16.076246 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:16.310986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:16.319351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:16.320759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:16.321976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-abea85fa-0a23-4331-bf15-96581b1d9479 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1724 microversion: 2.20 time: 0.264854 Sep 12 23:32:16.335770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 284/572] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:16 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:16.464384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:16.465225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:16.472116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:16.472862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:16.473299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:16.474031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:16.474594 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:16.475116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:16.635354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:16.646016 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-071003cc-90f3-49e2-bb64-278a15ad58b6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.185712 Sep 12 23:32:16.647204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 289/573] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:16 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:16.699085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-e7e6c0c8-d2bf-44bc-867b-0fa0f4a0ecc0 req-b31f793a-5c61-46e9-9a33-db66c53ac81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07d4dcb-1679-4627-b94b-adc34cfffbb3", "name": "network-vif-deleted", "tag": "fbdc10fe-ce53-41fd-a771-18e381482273"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:16.708319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e7e6c0c8-d2bf-44bc-867b-0fa0f4a0ecc0 req-b31f793a-5c61-46e9-9a33-db66c53ac81b service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:16.709150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e7e6c0c8-d2bf-44bc-867b-0fa0f4a0ecc0 req-b31f793a-5c61-46e9-9a33-db66c53ac81b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:16.709275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e7e6c0c8-d2bf-44bc-867b-0fa0f4a0ecc0 req-b31f793a-5c61-46e9-9a33-db66c53ac81b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:16.721266 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-e7e6c0c8-d2bf-44bc-867b-0fa0f4a0ecc0 req-b31f793a-5c61-46e9-9a33-db66c53ac81b service nova] Creating event network-vif-deleted:fbdc10fe-ce53-41fd-a771-18e381482273 for instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 on hv-cinder-85200 Sep 12 23:32:16.727524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-e7e6c0c8-d2bf-44bc-867b-0fa0f4a0ecc0 req-b31f793a-5c61-46e9-9a33-db66c53ac81b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031994 Sep 12 23:32:16.729125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 285/574] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:17.348680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:17.349420 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:17.356773 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:17.358254 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:17.358697 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:17.359407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:17.360232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:17.361082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:17.396942 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:17.397915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:17.397915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:17.398283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lazy-loading 'fault' on Instance uuid e07d4dcb-1679-4627-b94b-adc34cfffbb3 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:32:17.443528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:17.454167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:17.456336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:17.457504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-54738409-4298-4280-8190-c8f8416e00d8 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 200 len: 1371 microversion: 2.20 time: 0.113237 Sep 12 23:32:17.459524 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 290/575] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:17 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:17.671748 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:17.672689 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:17.683786 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:17.685079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:17.686192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:17.687904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:17.688935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:17.689652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:17.831348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:17.839893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-13b42ded-9689-48c9-98be-e2a79fec2976 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.172837 Sep 12 23:32:17.840533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 286/576] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:17 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:18.482656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:18.483277 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:18.490138 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:18.490630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:18.491065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:18.491800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:18.492253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:18.492694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:18.509540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] HTTP exception thrown: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Request method failure captured: Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 HTTP/1.1 Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CHhAHx0_QAUKRM8mT4BD5XqJvirD8qB2pAvBTk7n84lYObmDRceuuAnQcAzxv5N12PDfotan24lB7vQV_obX3asbiYVzqoAgMIKfXJ1J2eSDMJl-A28ufYuLzsDiTfuzNhvfsGQTCO59pi7baPR2i4XtF5FhPpBe0zQCa8YShwPV4 Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:32:18.511232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aa1c574bdd14a1bb0ae5f82f892e6bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}] Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 2749a61b3dd04d89a5c2e4235aa96934 Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:32:18.512966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'e07d4dcb-1679-4627-b94b-adc34cfffbb3'} Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:32:18.513944 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:32:18.515454 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:18.517596 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Returning 404 to user: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:32:18.518472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-21769bc9-a227-4b4e-8c0b-e32ca7142328 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 404 len: 111 microversion: 2.20 time: 0.039854 Sep 12 23:32:18.519066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 291/577] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:18 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 12 23:32:18.528565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9e02a463-84c2-4e08-9dcd-17b19a5dd8f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '.version_select at 0x7fa4b380f9d0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:18.549548 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9e02a463-84c2-4e08-9dcd-17b19a5dd8f0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819024859" status: 204 len: 0 microversion: 2.20 time: 0.025557 Sep 12 23:32:18.550054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 287/578] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Sep 12 23:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819024859 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 12 23:32:18.863060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:18.863598 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:18.870445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:18.871335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:18.872492 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:18.873737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:18.874800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:18.875761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:19.197059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:19.205361 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-174d9ac7-5903-4d25-978c-86b89bbe9538 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.346184 Sep 12 23:32:19.205927 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 292/579] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:18 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:19.508719 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d9b8bf13-66d0-4fb7-bf0d-1e8f95898a29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'create', calling method: .version_select at 0x7fa4b38065e0>, body: {"keypair": {"name": "tempest-keypair-1552965095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9CJK97Op0rVcx2HyKVHWpCuguiJG8tPjoWX/mrcmuU1huhny55sd3U6pZoF86uVssEvy6Hb93Lnw8b+H0S8drKLUOzdsyuP3/IpErqK3HYhCeB/9N7FJL23ycv7Fv9Qg=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:19.524782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-d9b8bf13-66d0-4fb7-bf0d-1e8f95898a29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:32:19.528814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-d9b8bf13-66d0-4fb7-bf0d-1e8f95898a29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for user 2749a61b3dd04d89a5c2e4235aa96934 and project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:32:19.550691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d9b8bf13-66d0-4fb7-bf0d-1e8f95898a29 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046486 Sep 12 23:32:19.551292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 288/580] 10.222.0.27 () {62 vars in 1200 bytes} [Mon Sep 12 23:32:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 12 23:32:20.228134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:20.228843 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:20.234912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:20.235390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:20.235850 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:20.236530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:20.236972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:20.237386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:20.455083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:20.463202 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3a1069e9-6f9c-407b-b3ce-4d3fad325aa5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.238941 Sep 12 23:32:20.463907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 293/581] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:20 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:20.884112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1151790609", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11be7f0c-3ec4-4c81-8e43-cbebcc992505"}], "security_groups": [{"name": "tempest-securitygroup--2097941164"}], "key_name": "tempest-keypair-1552965095", "user_data": "}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:20.991398 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] validate_networks() for [('11be7f0c-3ec4-4c81-8e43-cbebcc992505', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:32:21.349435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:32:21.349858 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:32:21.350324 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:32:21.350722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:32:21.351121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:32:21.359733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:21.360207 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:21.360630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:21.361337 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:21.361779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:21.362198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:21.378080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:32:21.381964 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Getting quotas for user 2749a61b3dd04d89a5c2e4235aa96934 and project 5aa1c574bdd14a1bb0ae5f82f892e6bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:32:21.392991 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:32:21.395206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:32:21.443594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9d04cfd4-f358-4588-888b-89c779d527e0 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.564208 Sep 12 23:32:21.444285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 289/582] 10.222.0.27 () {62 vars in 1188 bytes} [Mon Sep 12 23:32:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 23:32:21.455800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1b547568-ce5d-4975-8d9f-8086525b1eed tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:21.456393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1b547568-ce5d-4975-8d9f-8086525b1eed tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:21.486553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:21.487152 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:21.494856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:21.495342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:21.495807 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:21.496495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:21.496940 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:21.497359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:21.513474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1b547568-ce5d-4975-8d9f-8086525b1eed tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:21.520635 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1b547568-ce5d-4975-8d9f-8086525b1eed tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:21.522058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1b547568-ce5d-4975-8d9f-8086525b1eed tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:21.523150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1b547568-ce5d-4975-8d9f-8086525b1eed tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1282 microversion: 2.20 time: 0.071144 Sep 12 23:32:21.523938 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 294/583] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:21 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:21.632875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:21.641641 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-02044cf7-04d2-4d51-9f03-be5ecca18bf6 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.158582 Sep 12 23:32:21.642478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 290/584] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:21 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:32:22.547746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:22.548260 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:22.555188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:22.555755 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:22.556183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:22.556858 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:22.557305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:22.557721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:22.620494 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:22.629450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:22.630885 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:22.632027 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b615ae39-5201-4832-9ffb-815811c166f4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1334 microversion: 2.20 time: 0.088391 Sep 12 23:32:22.632591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 295/585] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:22 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:22.666888 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:22.667499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:22.675339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:22.676533 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:22.676944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:22.677651 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:22.678416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:22.678851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:22.869158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:22.877303 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3e7674ac-6127-4a22-8699-159fb32c2001 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.214897 Sep 12 23:32:22.877872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 291/586] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:22 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:23.665889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:23.666625 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:23.674599 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:23.675310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:23.675891 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:23.676688 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:23.677166 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:23.677592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:23.811947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:23.820221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:23.821717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:23.822817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-580b098d-56f8-4b77-b8b9-fc30b2c09068 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.161729 Sep 12 23:32:23.823378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 296/587] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:23 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:23.901123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:23.901726 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:23.908266 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:23.908744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:23.909171 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:23.909850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:23.910323 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:23.910737 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:24.122420 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:24.130608 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-59dc4b45-165a-4f23-b71f-f8e9a442fe58 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.233833 Sep 12 23:32:24.131636 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 292/588] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:23 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:24.158995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-c3ff0c68-f94d-4b25-b0a1-d65bd6118583 req-51f13ae2-945d-42dd-b6e1-5de45a51abb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835d0938-03f8-42b8-b626-831891902172", "tag": "0caf572f-5337-4893-9c4d-eaccaf716b83"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:24.170665 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-c3ff0c68-f94d-4b25-b0a1-d65bd6118583 req-51f13ae2-945d-42dd-b6e1-5de45a51abb9 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:24.171147 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-c3ff0c68-f94d-4b25-b0a1-d65bd6118583 req-51f13ae2-945d-42dd-b6e1-5de45a51abb9 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:24.171605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-c3ff0c68-f94d-4b25-b0a1-d65bd6118583 req-51f13ae2-945d-42dd-b6e1-5de45a51abb9 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:24.182596 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-c3ff0c68-f94d-4b25-b0a1-d65bd6118583 req-51f13ae2-945d-42dd-b6e1-5de45a51abb9 service nova] Creating event network-changed:0caf572f-5337-4893-9c4d-eaccaf716b83 for instance 835d0938-03f8-42b8-b626-831891902172 on hv-cinder-85200 Sep 12 23:32:24.187215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-c3ff0c68-f94d-4b25-b0a1-d65bd6118583 req-51f13ae2-945d-42dd-b6e1-5de45a51abb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Sep 12 23:32:24.187888 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 297/589] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:24.848183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:24.848697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:24.854479 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:24.854952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:24.855378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:24.856072 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:24.856515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:24.856928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:24.984073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:24.991990 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:24.994060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:24.995148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6eb15b3e-db39-42f5-a3a3-8b4e97c6036e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.150936 Sep 12 23:32:24.995711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 293/590] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:24 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:25.155513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:25.156161 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:25.162197 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:25.162685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:25.163118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:25.163829 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:25.164282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:25.165214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:25.293018 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:25.301190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-814a0a0b-f230-47f4-a1c8-9cf45c4c4e39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.150675 Sep 12 23:32:25.301766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 298/591] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:25 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:26.020203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:26.020910 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:26.028194 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:26.028725 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:26.029156 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:26.029893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:26.030368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:26.030784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:26.253539 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:26.257030 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:26.263942 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:26.265361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:26.266463 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-26178b02-df26-4fa0-95a1-0022eb7c9b52 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.250226 Sep 12 23:32:26.267030 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 294/592] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:26 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:26.325036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:26.325643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:26.331994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:26.332480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:26.332915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:26.333607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:26.334134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:26.334563 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:26.465949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:26.474163 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-fe13a2c2-9dce-4410-83f9-13e83b777a41 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.153033 Sep 12 23:32:26.474730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 299/593] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:26 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:27.293207 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:27.293779 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:27.301241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:27.301720 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:27.302176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:27.302861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:27.303312 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:27.303767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:27.441207 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:27.449230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:27.450647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:27.451817 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-62315353-5ec9-4a0c-99e2-6967143bb807 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.163435 Sep 12 23:32:27.452368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 295/594] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:27 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:27.498505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:27.499104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:27.505448 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:27.505923 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:27.506341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:27.507013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:27.507452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:27.507911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:27.525078 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:27.634826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:27.642923 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6715ae5c-c7e5-4657-977d-6f07d5db5cdf tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.148208 Sep 12 23:32:27.643481 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 300/595] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:27 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:28.477662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:28.478312 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:28.485739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:28.486225 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:28.486659 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:28.487349 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:28.487827 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:28.488248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:28.616587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:28.624611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:28.626027 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:28.627109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4306aa91-0fd4-4117-a82b-14c6df540bba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.154485 Sep 12 23:32:28.627680 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 296/596] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:28 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:28.666867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:28.667467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:28.674041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:28.674508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:28.674943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:28.675657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:28.676109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:28.676558 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:28.806733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:28.814914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1a61ae23-32de-45ac-a404-d2b04748135f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.152564 Sep 12 23:32:28.815492 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 301/597] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:28 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:29.652408 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:29.652926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:29.659260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:29.659789 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:29.660219 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:29.660896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:29.661341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:29.661762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:29.792645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:29.800540 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:29.801964 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:29.803081 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a20619c7-36da-43d1-9f84-97883786ec13 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.155623 Sep 12 23:32:29.803648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 297/598] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:29 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:29.838805 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:29.839412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:29.845817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:29.846297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:29.846727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:29.847411 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:29.847889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:29.848312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:29.973801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:29.982049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b2f6d359-0b78-48f7-85d7-b7a4fd10857c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.147774 Sep 12 23:32:29.982618 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 302/599] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:29 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:30.367430 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-3caff58d-0eb4-40df-a3f4-d7a0e5ceb7b6 req-3215e336-be9b-4e36-afd7-a923bfb7df91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835d0938-03f8-42b8-b626-831891902172", "name": "network-vif-plugged", "status": "completed", "tag": "0caf572f-5337-4893-9c4d-eaccaf716b83"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:30.377294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3caff58d-0eb4-40df-a3f4-d7a0e5ceb7b6 req-3215e336-be9b-4e36-afd7-a923bfb7df91 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:30.378238 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3caff58d-0eb4-40df-a3f4-d7a0e5ceb7b6 req-3215e336-be9b-4e36-afd7-a923bfb7df91 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:30.378238 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3caff58d-0eb4-40df-a3f4-d7a0e5ceb7b6 req-3215e336-be9b-4e36-afd7-a923bfb7df91 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:30.389577 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-3caff58d-0eb4-40df-a3f4-d7a0e5ceb7b6 req-3215e336-be9b-4e36-afd7-a923bfb7df91 service nova] Creating event network-vif-plugged:0caf572f-5337-4893-9c4d-eaccaf716b83 for instance 835d0938-03f8-42b8-b626-831891902172 on hv-cinder-85200 Sep 12 23:32:30.394501 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-3caff58d-0eb4-40df-a3f4-d7a0e5ceb7b6 req-3215e336-be9b-4e36-afd7-a923bfb7df91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030847 Sep 12 23:32:30.395089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 298/600] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:30.827699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:30.828300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:30.834162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:30.834643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:30.835073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:30.835777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:30.836280 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:30.836702 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:30.966099 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:30.974119 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:30.975554 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:30.977159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f515d195-55bf-4360-a202-7fd8b826aa63 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.152853 Sep 12 23:32:30.977709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 303/601] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:30 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:31.005800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:31.006482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:31.012508 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:31.012983 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:31.013412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:31.014083 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:31.014529 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:31.014946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:31.142108 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:31.150180 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-46b12528-9fb2-4578-98a7-ae11b2680d85 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.148940 Sep 12 23:32:31.150742 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 299/602] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:30 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:32.004083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:32.006116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:32.006637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:32.007287 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:32.012835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:32.013307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:32.013731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:32.014409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:32.014852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:32.015271 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:32.143986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:32.152253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:32.153692 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:32.154788 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-239604f2-a66d-49c4-b0a8-4ddf56b3be38 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1408 microversion: 2.20 time: 0.154935 Sep 12 23:32:32.155345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 304/603] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:31 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:32:32.173345 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:32.173980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:32.175929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:32.176619 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=10 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:32.183342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:32.183846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:32.184280 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:32.184964 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:32.185415 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:32.185834 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:32.312345 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:32.321022 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b73193bf-ecad-49d7-af8f-ca121d401529 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.150757 Sep 12 23:32:32.321585 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 300/604] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:32 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:33.179239 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:33.179890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:33.186489 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:33.186971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:33.187405 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:33.188128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:33.188577 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:33.189000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:33.316426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:33.325153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:33.326608 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:33.327789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3ff7c2d4-ec3b-4165-97a5-65c32cb7b188 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1600 microversion: 2.20 time: 0.152759 Sep 12 23:32:33.328347 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 305/605] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:32:33 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:32:33.344510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:33.345203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:33.351729 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:33.352140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:33.352369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:33.352629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:33.352938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:33.353692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:33.354218 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:33.354707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:33.359749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:33.359749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:33.359749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:33.360189 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:33.360642 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:33.361069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:33.439813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0009e0c7-b784-4fd2-a229-8f298a3706e7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091367 Sep 12 23:32:33.440410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 306/606] 10.222.0.27 () {60 vars in 1316 bytes} [Mon Sep 12 23:32:33 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:32:33.487697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:33.496245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f05763cc-57f9-4d9e-947f-02948e8fcfd3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1736 microversion: 2.1 time: 0.155389 Sep 12 23:32:33.496931 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 301/607] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:33 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:34.359459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-5e62f1d3-06f9-4a84-9d4a-351c08faaded req-feca995f-907b-4b15-bd5d-536046dbe47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835d0938-03f8-42b8-b626-831891902172", "tag": "0caf572f-5337-4893-9c4d-eaccaf716b83"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:34.369585 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5e62f1d3-06f9-4a84-9d4a-351c08faaded req-feca995f-907b-4b15-bd5d-536046dbe47d service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.370069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5e62f1d3-06f9-4a84-9d4a-351c08faaded req-feca995f-907b-4b15-bd5d-536046dbe47d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.370575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5e62f1d3-06f9-4a84-9d4a-351c08faaded req-feca995f-907b-4b15-bd5d-536046dbe47d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.381798 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-5e62f1d3-06f9-4a84-9d4a-351c08faaded req-feca995f-907b-4b15-bd5d-536046dbe47d service nova] Creating event network-changed:0caf572f-5337-4893-9c4d-eaccaf716b83 for instance 835d0938-03f8-42b8-b626-831891902172 on hv-cinder-85200 Sep 12 23:32:34.386662 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-5e62f1d3-06f9-4a84-9d4a-351c08faaded req-feca995f-907b-4b15-bd5d-536046dbe47d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031272 Sep 12 23:32:34.387255 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 307/608] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:34.521873 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:34.523124 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:34.533649 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:34.536059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:34.545905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.548044 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.548591 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.549108 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.549902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.550388 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.550975 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.551503 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.552011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.552947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.557786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.558123 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.588461 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8da4fb78-e310-40bc-9ed5-21bd520e544a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059793 Sep 12 23:32:34.589280 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 308/609] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:32:34 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:32:34.661397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:34.661925 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:34.668532 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.669023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.669468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.670175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.670604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.671032 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.698088 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:32:34.793922 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f19898eb-1c06-4ffb-a16f-3dfd3f824245 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 204 len: 0 microversion: 2.1 time: 0.136203 Sep 12 23:32:34.795410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 309/610] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:32:34 2022] DELETE /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:32:34.803620 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:34.805361 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:34.806501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:34.811906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.814443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.814443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.814443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.814443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.814843 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.816050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-831390e6-adaf-4d4f-bef6-ee8b57a945c5 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1716 microversion: 2.1 time: 0.299302 Sep 12 23:32:34.816629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 302/611] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:34 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1716 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:34.959329 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:34.959887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:34.966982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.967776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.968220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.968924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:34.969385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:34.969806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:34.977802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:34.988570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5e990d30-b251-4336-bada-e585b894867e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1673 microversion: 2.1 time: 0.187509 Sep 12 23:32:34.989401 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 310/612] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:34 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:35.057633 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] HTTP exception thrown: Cannot 'detach_volume' instance b8328773-645f-4acb-aad8-2984c3b13211 while it is in vm_state rescued Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Request method failure captured: Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments/c9727947-4ff3-4926-aa95-b98879a4c61d HTTP/1.1 Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CQG8HWeNfiOq8aQUdKHghkL1T74BE2NK7glrno7hGRP54QGm9BSgGXmwXMs2E-pxWIdN3TMzPYtwdXcoJv4iZlV4avk6LOr7rxtXGI_UiurrLxxb7ejEy2_TxfEYaUxoqyNtg7kEOL-rgzugQdbzNpgJOhNTsdgyZKuJDgq9Bx2eU Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:32:35.059241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc049ff85c14935a9f68be76cd61c05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}] Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 0248519bf5b54ce3ba3b40f2c9a4c628 Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:32:35.060586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Cannot 'detach_volume' instance b8328773-645f-4acb-aad8-2984c3b13211 while it is in vm_state rescued Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'server_id': 'b8328773-645f-4acb-aad8-2984c3b13211', 'id': 'c9727947-4ff3-4926-aa95-b98879a4c61d'} Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8328773-645f-4acb-aad8-2984c3b13211 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:32:35.061283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b8328773-645f-4acb-aad8-2984c3b13211 while it is in vm_state rescued Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b8328773-645f-4acb-aad8-2984c3b13211 while it is in vm_state rescued Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:32:35.062547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Returning 409 to user: Cannot 'detach_volume' instance b8328773-645f-4acb-aad8-2984c3b13211 while it is in vm_state rescued {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:32:35.063504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7d3ce7da-1eeb-4205-9e07-b6559f8a6813 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments/c9727947-4ff3-4926-aa95-b98879a4c61d" status: 409 len: 152 microversion: 2.1 time: 0.106423 Sep 12 23:32:35.063504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 303/613] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:32:34 2022] DELETE /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments/c9727947-4ff3-4926-aa95-b98879a4c61d => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 12 23:32:35.069959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:35.071009 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:35.076887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:35.077365 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:35.077793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:35.078472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:35.078918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:35.079334 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:35.150335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-82fe9024-dea8-4eca-bc98-aaad99f69d20 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "POST /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/action" status: 202 len: 0 microversion: 2.1 time: 0.084026 Sep 12 23:32:35.154368 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 311/614] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:32:35 2022] POST /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:32:35.159610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:35.160234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:35.166428 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:35.166929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:35.167370 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:35.168105 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:35.168562 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:35.168985 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:35.301864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:35.310920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-15961a30-0b75-40ae-a6f6-a73ce58c9163 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1724 microversion: 2.1 time: 0.155156 Sep 12 23:32:35.311473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 304/615] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:35 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:36.013580 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:36.014276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:36.020373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:36.020851 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:36.021283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:36.021999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:36.022481 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:36.022909 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:36.150007 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:36.157807 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-74d6b558-f599-4e8f-9088-85dbf09c21c7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1673 microversion: 2.1 time: 0.149006 Sep 12 23:32:36.158364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 312/616] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:36 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:36.334322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:36.334933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:36.341919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:36.342402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:36.342839 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:36.343522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:36.344000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:36.344422 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:36.473326 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:36.482020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-573dcffa-2701-44b7-bfd6-a7c91255f343 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1724 microversion: 2.1 time: 0.151535 Sep 12 23:32:36.482575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 305/617] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:36 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:37.181793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:37.182543 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:37.189216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:37.189660 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:37.190092 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:37.190784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:37.191236 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:37.191680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:37.354495 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:37.363233 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-14a91410-1984-4a06-84f0-e59e6b143121 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1673 microversion: 2.1 time: 0.185548 Sep 12 23:32:37.363907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 313/618] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:37 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:37.507192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:37.510359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:37.517101 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:37.517646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:37.518119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:37.518833 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:37.519285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:37.519929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:37.728744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:37.736909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ddfe0c4c-2863-49bc-bd56-b7d8d7359695 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1724 microversion: 2.1 time: 0.234964 Sep 12 23:32:37.737570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 306/619] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:37 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:37.840476 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-13bec8d6-5af4-4bdd-9fb9-853aaa58dd6b req-7abc1fbd-07e1-4137-9aac-a1bbff0a4a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbaafcd0-103d-4e1a-a15e-fc8997acceef", "name": "network-vif-deleted", "tag": "f432d2c4-e8e1-4abe-b933-41ca765c4f52"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:37.849966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-13bec8d6-5af4-4bdd-9fb9-853aaa58dd6b req-7abc1fbd-07e1-4137-9aac-a1bbff0a4a5d service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:37.850727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-13bec8d6-5af4-4bdd-9fb9-853aaa58dd6b req-7abc1fbd-07e1-4137-9aac-a1bbff0a4a5d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:37.851153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-13bec8d6-5af4-4bdd-9fb9-853aaa58dd6b req-7abc1fbd-07e1-4137-9aac-a1bbff0a4a5d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:37.863436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-13bec8d6-5af4-4bdd-9fb9-853aaa58dd6b req-7abc1fbd-07e1-4137-9aac-a1bbff0a4a5d service nova] Creating event network-vif-deleted:f432d2c4-e8e1-4abe-b933-41ca765c4f52 for instance bbaafcd0-103d-4e1a-a15e-fc8997acceef on hv-cinder-85200 Sep 12 23:32:37.869364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-13bec8d6-5af4-4bdd-9fb9-853aaa58dd6b req-7abc1fbd-07e1-4137-9aac-a1bbff0a4a5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032380 Sep 12 23:32:37.870378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 314/620] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:38.387671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:38.388723 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:38.394926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:38.395414 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:38.395879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:38.396797 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:38.397241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:38.397677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:38.460589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:38.468836 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5fd40907-383e-453e-ac4e-f3a0f50f02e1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1605 microversion: 2.1 time: 0.085065 Sep 12 23:32:38.469395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 307/621] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:38 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:38.762157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:38.762963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:38.769185 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:38.769764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:38.770200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:38.770903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:38.771468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:38.771931 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:38.925146 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:38.933791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b843f761-76ff-4b90-9dc9-b11f5416c7c2 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1724 microversion: 2.1 time: 0.176833 Sep 12 23:32:38.934348 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 315/622] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:38 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:32:39.493024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:39.493870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:39.496334 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:39.502657 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:39.503258 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:39.503809 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:39.504684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:39.505274 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:39.505766 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:39.539315 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:39.539832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:39.540270 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:39.540710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lazy-loading 'fault' on Instance uuid bbaafcd0-103d-4e1a-a15e-fc8997acceef {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:32:39.583895 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:39.592107 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-eadfda10-cc8f-425e-aa88-a841a10cf37d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 200 len: 1327 microversion: 2.1 time: 0.103128 Sep 12 23:32:39.592666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 308/623] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:39 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:39.957817 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:39.958422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:39.964745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:39.965229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:39.965698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:39.966378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:39.966828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:39.967249 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:39.971312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:40.095216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:40.103828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6c8a4b07-cb51-420f-8248-d46c095fae39 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1730 microversion: 2.1 time: 0.149924 Sep 12 23:32:40.104383 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 316/624] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:39 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:40.127064 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:40.127686 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:40.133545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:40.134015 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:40.134441 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:40.135110 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:40.135554 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:40.135991 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:40.210772 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4ed7b1fd-e60a-4b36-8822-230e16b3cf68 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087476 Sep 12 23:32:40.211376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 309/625] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:32:40 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:40.614464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:40.614987 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:40.620859 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:40.621340 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:40.621775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:40.622457 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:40.622913 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:40.623339 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:40.636286 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] HTTP exception thrown: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Request method failure captured: Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef HTTP/1.1 Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CKTzEgBjPYpywSweb1rz1OpcSEkYED0pK_quHqmC9yeb9kWsN2G0LxLWyjJAOh3pzpmoSP3XPaOkvX-jsnKTcR7kb-twO1uzehLMdSuA9B9xjH3ISrDFvV8rBsW9iy855X7xQmtmIOTsBf1chDAUKJsi77IZuJcV7DsFOtvPRQroU Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:32:40.637986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8ffe803ce4b4d0181be62e1dfb094bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}] Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 7f56dde21c754cfe8253ec5c1b7b90d7 Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:32:40.639630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'bbaafcd0-103d-4e1a-a15e-fc8997acceef'} Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:32:40.640508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:32:40.641918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:32:40.643212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Returning 404 to user: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:32:40.643212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-889fdea5-28ef-420a-b22b-f15d4b6b4d17 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 404 len: 111 microversion: 2.1 time: 0.028921 Sep 12 23:32:40.643212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 317/626] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:40 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:32:40.650424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b49672a5-7ba3-4fb0-8625-81fa46e32b76 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '.version_select at 0x7fa4b3738f70>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:40.669917 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b49672a5-7ba3-4fb0-8625-81fa46e32b76 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423738299" status: 202 len: 0 microversion: 2.1 time: 0.025212 Sep 12 23:32:40.670489 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 310/627] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Sep 12 23:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423738299 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:32:41.101582 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-99f603f2-221a-402e-818c-33d882c77f24 req-d62efbb0-71c7-4f0f-ad77-b820e12287e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8328773-645f-4acb-aad8-2984c3b13211", "tag": "d24cc5eb-346a-4639-811c-1a0c53b0e5cc"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:41.116663 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-99f603f2-221a-402e-818c-33d882c77f24 req-d62efbb0-71c7-4f0f-ad77-b820e12287e5 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:41.117497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-99f603f2-221a-402e-818c-33d882c77f24 req-d62efbb0-71c7-4f0f-ad77-b820e12287e5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:41.118145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-99f603f2-221a-402e-818c-33d882c77f24 req-d62efbb0-71c7-4f0f-ad77-b820e12287e5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:41.133747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-99f603f2-221a-402e-818c-33d882c77f24 req-d62efbb0-71c7-4f0f-ad77-b820e12287e5 service nova] Creating event network-changed:d24cc5eb-346a-4639-811c-1a0c53b0e5cc for instance b8328773-645f-4acb-aad8-2984c3b13211 on hv-cinder-85200 Sep 12 23:32:41.139738 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-99f603f2-221a-402e-818c-33d882c77f24 req-d62efbb0-71c7-4f0f-ad77-b820e12287e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041711 Sep 12 23:32:41.140950 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 318/628] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:41.577678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-94ee6f30-14b7-4588-a12c-235fe9186038 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'create', calling method: .version_select at 0x7fa4b3743d30>, body: {"keypair": {"name": "tempest-keypair-1457400543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUb8/9gKYSI3fndFRTCbm7kJyt9Z7IBx7d6yce92QGa2sU/AMH78n7ts9IyWS2XcN+JPoToKrMS/eUqdY17ijw9pccXsB24XLlwdTLuRDtRxe63vnNtVk0oTqRzlxRuNQ=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:41.595646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-94ee6f30-14b7-4588-a12c-235fe9186038 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:32:41.599900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-94ee6f30-14b7-4588-a12c-235fe9186038 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for user 7f56dde21c754cfe8253ec5c1b7b90d7 and project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:32:41.627547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-94ee6f30-14b7-4588-a12c-235fe9186038 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055321 Sep 12 23:32:41.628437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 311/629] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:32:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:32:42.951691 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-177210769", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87d38067-03b8-4be7-846c-3dce062309f6"}], "security_groups": [{"name": "tempest-securitygroup--1264969245"}], "key_name": "tempest-keypair-1457400543", "user_data": "}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:43.055467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] validate_networks() for [('87d38067-03b8-4be7-846c-3dce062309f6', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:32:43.155700 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-2ad9f7c1-4761-4486-8c20-3fcfc18fa6d8 req-106fe84a-837d-4381-a300-5f941b69cce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8328773-645f-4acb-aad8-2984c3b13211", "tag": "d24cc5eb-346a-4639-811c-1a0c53b0e5cc"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:43.166681 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2ad9f7c1-4761-4486-8c20-3fcfc18fa6d8 req-106fe84a-837d-4381-a300-5f941b69cce0 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:43.167672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2ad9f7c1-4761-4486-8c20-3fcfc18fa6d8 req-106fe84a-837d-4381-a300-5f941b69cce0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:43.167781 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2ad9f7c1-4761-4486-8c20-3fcfc18fa6d8 req-106fe84a-837d-4381-a300-5f941b69cce0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:43.178625 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-2ad9f7c1-4761-4486-8c20-3fcfc18fa6d8 req-106fe84a-837d-4381-a300-5f941b69cce0 service nova] Creating event network-changed:d24cc5eb-346a-4639-811c-1a0c53b0e5cc for instance b8328773-645f-4acb-aad8-2984c3b13211 on hv-cinder-85200 Sep 12 23:32:43.183832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-2ad9f7c1-4761-4486-8c20-3fcfc18fa6d8 req-106fe84a-837d-4381-a300-5f941b69cce0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Sep 12 23:32:43.184438 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 312/630] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:43.462148 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:32:43.462706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:32:43.463870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:32:43.464473 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:32:43.465061 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:32:43.474077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:43.474564 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:43.474997 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:43.475754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:43.476210 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:43.476634 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:43.494036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:32:43.497985 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Getting quotas for user 7f56dde21c754cfe8253ec5c1b7b90d7 and project b8ffe803ce4b4d0181be62e1dfb094bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:32:43.509594 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:32:43.512040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:32:43.560779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-889de72f-d572-4d7a-8da5-4667d64907cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614265 Sep 12 23:32:43.561422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 319/631] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:32:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:32:43.573634 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e0d251f9-25e5-427f-a50b-08af835c6956 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:43.574338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e0d251f9-25e5-427f-a50b-08af835c6956 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:43.647336 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e0d251f9-25e5-427f-a50b-08af835c6956 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:43.654488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e0d251f9-25e5-427f-a50b-08af835c6956 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1237 microversion: 2.1 time: 0.085691 Sep 12 23:32:43.655066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 313/632] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:43 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:44.679064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:44.679695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:44.686564 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:44.687044 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:44.687474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:44.688181 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:44.688630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:44.689049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:44.752521 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:44.762939 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-17044efe-f4d4-4914-ae4a-5cf2d2312ab0 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1289 microversion: 2.1 time: 0.088716 Sep 12 23:32:44.763546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 320/633] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:44 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:45.789891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:45.790581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:45.797168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:45.797645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:45.798074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:45.798754 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:45.799202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:45.799645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:46.018705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:46.028763 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a27a64fb-6bc7-40f5-ae7d-eec58913e5b4 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.243916 Sep 12 23:32:46.029262 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 314/634] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:45 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:46.245237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-1044c659-97d4-4cdd-80c0-a8c9c90a21ff req-8d842e5f-a2c9-4c45-b71b-5b981b29eb6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985bbb7e-d077-499f-ba1b-70b1191389d3", "tag": "a6f30f79-4144-4a51-a80a-931cea883d79"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:46.255495 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-1044c659-97d4-4cdd-80c0-a8c9c90a21ff req-8d842e5f-a2c9-4c45-b71b-5b981b29eb6e service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:46.256033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-1044c659-97d4-4cdd-80c0-a8c9c90a21ff req-8d842e5f-a2c9-4c45-b71b-5b981b29eb6e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:46.256480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-1044c659-97d4-4cdd-80c0-a8c9c90a21ff req-8d842e5f-a2c9-4c45-b71b-5b981b29eb6e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:46.268461 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-1044c659-97d4-4cdd-80c0-a8c9c90a21ff req-8d842e5f-a2c9-4c45-b71b-5b981b29eb6e service nova] Creating event network-changed:a6f30f79-4144-4a51-a80a-931cea883d79 for instance 985bbb7e-d077-499f-ba1b-70b1191389d3 on hv-cinder-85200 Sep 12 23:32:46.273012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-1044c659-97d4-4cdd-80c0-a8c9c90a21ff req-8d842e5f-a2c9-4c45-b71b-5b981b29eb6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031630 Sep 12 23:32:46.274213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 321/635] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:47.051854 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:47.052459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:47.059425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:47.059939 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:47.060379 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:47.061059 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:47.061508 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:47.061928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:47.193135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:47.196645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:47.201529 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-58551a15-4d98-4ff3-b819-e24d70de591a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.153552 Sep 12 23:32:47.202086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 315/636] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:47 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:48.225486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:48.226601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:48.232693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:48.233170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:48.233603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:48.234284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:48.234732 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:48.235151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:48.361403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:48.369587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f82c0683-a06a-456a-b93b-4b73013a68dd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.148826 Sep 12 23:32:48.370155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 322/637] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:48 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:49.392212 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:49.392804 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:49.399739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:49.400215 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:49.400643 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:49.401321 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:49.402034 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:49.402454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:49.535743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:49.543936 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e3baea82-bc5b-4276-b7af-7367ad7d25b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.155644 Sep 12 23:32:49.545095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 316/638] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:49 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:50.566272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:50.566874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:50.573837 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:50.574317 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:50.574748 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:50.575430 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:50.575910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:50.576333 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:50.706654 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:50.717367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d92bd1bd-c5f6-4bcf-8636-85e1df683f44 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.155022 Sep 12 23:32:50.717965 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 323/639] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:50 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:51.740871 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:51.741477 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:51.748520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:51.749004 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:51.749438 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:51.750123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:51.750593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:51.750992 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:51.879954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:51.888069 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-05b18582-393c-4085-a12b-c6898b030474 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.151008 Sep 12 23:32:51.888627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 317/640] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:51 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:52.484418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-a800ed38-bbe2-46e8-9125-685930703cfa req-ed2ba034-7e89-429a-939f-f3824486b470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985bbb7e-d077-499f-ba1b-70b1191389d3", "name": "network-vif-plugged", "status": "completed", "tag": "a6f30f79-4144-4a51-a80a-931cea883d79"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:52.495918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a800ed38-bbe2-46e8-9125-685930703cfa req-ed2ba034-7e89-429a-939f-f3824486b470 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:52.496394 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a800ed38-bbe2-46e8-9125-685930703cfa req-ed2ba034-7e89-429a-939f-f3824486b470 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:52.497021 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a800ed38-bbe2-46e8-9125-685930703cfa req-ed2ba034-7e89-429a-939f-f3824486b470 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:52.508296 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-a800ed38-bbe2-46e8-9125-685930703cfa req-ed2ba034-7e89-429a-939f-f3824486b470 service nova] Creating event network-vif-plugged:a6f30f79-4144-4a51-a80a-931cea883d79 for instance 985bbb7e-d077-499f-ba1b-70b1191389d3 on hv-cinder-85200 Sep 12 23:32:52.512983 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-a800ed38-bbe2-46e8-9125-685930703cfa req-ed2ba034-7e89-429a-939f-f3824486b470 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032484 Sep 12 23:32:52.513787 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 324/641] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:52.910242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:52.910827 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:52.917266 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:52.917743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:52.918172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:52.918851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:52.919294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:52.919738 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:53.046837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:53.054678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-496e6f9e-726d-4b14-b847-34b5eeb89de9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.148230 Sep 12 23:32:53.055232 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 318/642] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:52 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:54.074235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:54.075679 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:54.080260 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:54.080936 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:54.088068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:54.088545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:54.088970 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:54.089644 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:54.090090 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:54.090505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:54.222211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:54.230433 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8b2617a4-a362-40f5-99fd-a99838eaa5b5 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1363 microversion: 2.1 time: 0.157130 Sep 12 23:32:54.231004 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 325/643] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:54 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:55.253277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:55.253911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:55.255802 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:32:55.261566 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:55.262041 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:55.262470 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:55.263147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:55.263610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:55.264032 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:55.389458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:32:55.397467 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c17620dc-b503-4c00-935e-49ba37157cdb tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1549 microversion: 2.1 time: 0.147984 Sep 12 23:32:55.398090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 319/644] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:32:55 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:32:55.419700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:32:55.420190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:32:55.426441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:55.426924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:55.427356 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:55.428065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:55.428517 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:55.429431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:55.508062 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3e6a8520-4dc2-42d1-9624-f69aab00deea tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091512 Sep 12 23:32:55.508665 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 326/645] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:32:55 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:32:56.404972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-a540fffb-efff-4acd-ab4a-429379d726af req-eb41ecc6-3f91-46db-8938-30894ed701a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985bbb7e-d077-499f-ba1b-70b1191389d3", "tag": "a6f30f79-4144-4a51-a80a-931cea883d79"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:32:56.415443 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a540fffb-efff-4acd-ab4a-429379d726af req-eb41ecc6-3f91-46db-8938-30894ed701a2 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:32:56.415935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a540fffb-efff-4acd-ab4a-429379d726af req-eb41ecc6-3f91-46db-8938-30894ed701a2 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:32:56.416740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a540fffb-efff-4acd-ab4a-429379d726af req-eb41ecc6-3f91-46db-8938-30894ed701a2 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:32:56.427351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-a540fffb-efff-4acd-ab4a-429379d726af req-eb41ecc6-3f91-46db-8938-30894ed701a2 service nova] Creating event network-changed:a6f30f79-4144-4a51-a80a-931cea883d79 for instance 985bbb7e-d077-499f-ba1b-70b1191389d3 on hv-cinder-85200 Sep 12 23:32:56.433189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-a540fffb-efff-4acd-ab4a-429379d726af req-eb41ecc6-3f91-46db-8938-30894ed701a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032085 Sep 12 23:32:56.433787 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 320/646] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:10.619371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:10.620073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=42 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:10.680399 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:10.680937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:10.686755 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:10.687234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:10.687707 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:10.688391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:10.688839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:10.689260 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:10.712161 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e40cbb6d-d87b-4441-a3a9-a86773f400a7 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/ips" status: 200 len: 152 microversion: 2.20 time: 0.094368 Sep 12 23:33:10.712703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 327/647] 10.222.0.27 () {60 vars in 1289 bytes} [Mon Sep 12 23:33:10 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/ips => generated 152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:33:13.230497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:13.231039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:13.233331 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:13.233956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=26 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:13.241071 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.241563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.241987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.242661 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.243103 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.243515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.266901 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lazy-loading 'flavor' on Instance uuid 835d0938-03f8-42b8-b626-831891902172 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:33:13.492088 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:13.492561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:13.498758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.499240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.499703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.500390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.500842 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.501267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.549730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-76f07f85-61fd-4dfa-bcb6-e8c4424d4faf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/action" status: 202 len: 0 microversion: 2.20 time: 0.323231 Sep 12 23:33:13.550325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 321/648] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Sep 12 23:33:13 2022] POST /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:33:13.560054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:13.560744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:13.567523 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.568123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.569082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.569865 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.570838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.571262 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.688525 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lazy-loading 'services' on Instance uuid b8328773-645f-4acb-aad8-2984c3b13211 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:33:13.715467 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:13.723658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:13.725307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:13.726531 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2d480913-64b8-4807-9c14-27365a13fc9d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.171782 Sep 12 23:33:13.727175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 322/649] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:13 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:13.760690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4718b405-0b69-4030-ab4c-44ea486a56b3 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments/c9727947-4ff3-4926-aa95-b98879a4c61d" status: 202 len: 0 microversion: 2.1 time: 0.272315 Sep 12 23:33:13.761460 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 328/650] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:33:13 2022] DELETE /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments/c9727947-4ff3-4926-aa95-b98879a4c61d => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:33:13.769914 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:13.772661 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:13.778934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.779548 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.780067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.780980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:13.781476 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:13.781941 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:13.812173 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c2d89601-7526-40af-9a7e-7e330fac3eb8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Sep 12 23:33:13.812727 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 323/651] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:33:13 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:14.752165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:14.752855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:14.759606 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:14.760091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:14.760525 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:14.761207 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:14.761659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:14.762078 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:14.825628 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:14.827802 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:14.834138 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:14.834628 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:14.835070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:14.835795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:14.836249 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:14.836676 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:14.870419 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-38b4ed73-e469-4d31-a894-17ad75b8f231 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048624 Sep 12 23:33:14.871014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 324/652] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:33:14 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 12 23:33:14.895804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:14.904242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:14.905749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:14.906964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-367616cb-fd85-42f8-851a-5b5c1d35553c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.159628 Sep 12 23:33:14.907615 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 329/653] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:14 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:14.954821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:14.955311 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:14.961148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:14.961620 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:14.962052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:14.962750 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:14.963195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:14.963633 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:14.988000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:33:15.061726 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d86b7d3c-f122-4290-b923-4d60535f76d8 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 204 len: 0 microversion: 2.1 time: 0.110408 Sep 12 23:33:15.062326 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 325/654] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:33:14 2022] DELETE /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:33:15.070595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:15.071205 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:15.077190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:15.077666 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:15.078110 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:15.078795 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:15.079264 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:15.079704 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:15.204915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:15.212559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d1315b37-58cd-44c0-b5c9-80247a1692bc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1690 microversion: 2.1 time: 0.145919 Sep 12 23:33:15.213165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 330/655] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:15 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:15.941848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:15.942542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:15.949368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:15.949846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:15.950279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:15.950954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:15.951411 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:15.951872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:16.078167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:16.086117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:16.087560 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:16.088731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d8bd1670-341d-4dc7-bf7c-b8f2f1e4fcc9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.151251 Sep 12 23:33:16.089279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 326/656] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:15 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:16.235951 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:16.236475 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:16.243214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:16.243724 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:16.244155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:16.244827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:16.245273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:16.245689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:16.370637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:16.378209 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d2db523f-cdca-4652-961e-54c2fa935817 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1690 microversion: 2.1 time: 0.146103 Sep 12 23:33:16.378778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 331/657] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:16 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:17.113714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:17.114361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:17.121277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:17.121756 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:17.122202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:17.122870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:17.123319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:17.123837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:17.247916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:17.255893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:17.257327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:17.258481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e278f4ac-79f4-4140-99f7-b09884b0977a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.148716 Sep 12 23:33:17.259060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 327/658] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:17 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:17.451042 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:17.451637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:17.457462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:17.457939 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:17.458370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:17.459045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:17.459490 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:17.459932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:17.591146 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:17.599278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b9dfe497-d8bf-4829-aacc-7f18c0465545 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1690 microversion: 2.1 time: 0.201382 Sep 12 23:33:17.600655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 332/659] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:17 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:18.283426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:18.284163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:18.290460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:18.290935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:18.291362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:18.292063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:18.292509 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:18.292920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:18.421012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:18.428854 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:18.430806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:18.432011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e6b54859-7e8b-41cb-9978-5a4db9e0a4ba tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.152396 Sep 12 23:33:18.432511 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 328/660] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:18 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:18.623251 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:18.623889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:18.630245 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:18.630730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:18.631166 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:18.631890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:18.632344 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:18.633412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:18.757959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:18.765462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-68386945-b1d6-4adb-ba5c-43dc78f46a94 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1690 microversion: 2.1 time: 0.146070 Sep 12 23:33:18.766025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 333/661] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:18 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:19.457503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:19.458101 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:19.465120 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:19.465604 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:19.466035 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:19.466722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:19.467168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:19.467644 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:19.789543 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:19.790205 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:19.802711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:19.803627 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:19.804827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:19.805800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:19.806492 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:19.807132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:19.912263 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:19.922693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0769a89d-80ac-4e19-a47f-77cfb09b5354 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 200 len: 1623 microversion: 2.1 time: 0.137060 Sep 12 23:33:19.924892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 334/662] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:19 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 1623 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:33:19.972341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:19.981611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-62756f30-d1d6-4b12-a304-f99c7681a5f3 req-4c06bf7b-ad9d-4487-a481-1c712301971b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8328773-645f-4acb-aad8-2984c3b13211", "name": "network-vif-deleted", "tag": "d24cc5eb-346a-4639-811c-1a0c53b0e5cc"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:19.982399 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:19.984126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:19.985686 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-726de13d-c335-4157-ad9e-f0d51821a5d5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.532050 Sep 12 23:33:19.987302 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 329/663] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:19 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:20.008952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-62756f30-d1d6-4b12-a304-f99c7681a5f3 req-4c06bf7b-ad9d-4487-a481-1c712301971b service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:20.009429 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-62756f30-d1d6-4b12-a304-f99c7681a5f3 req-4c06bf7b-ad9d-4487-a481-1c712301971b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:20.009855 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-62756f30-d1d6-4b12-a304-f99c7681a5f3 req-4c06bf7b-ad9d-4487-a481-1c712301971b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:20.020733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-62756f30-d1d6-4b12-a304-f99c7681a5f3 req-4c06bf7b-ad9d-4487-a481-1c712301971b service nova] Creating event network-vif-deleted:d24cc5eb-346a-4639-811c-1a0c53b0e5cc for instance b8328773-645f-4acb-aad8-2984c3b13211 on hv-cinder-85200 Sep 12 23:33:20.026695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-62756f30-d1d6-4b12-a304-f99c7681a5f3 req-4c06bf7b-ad9d-4487-a481-1c712301971b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058072 Sep 12 23:33:20.027285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 335/664] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:20.946598 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:20.947231 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: b8328773-645f-4acb-aad8-2984c3b13211] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:20.953667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:20.954153 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:20.954611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:20.955330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:20.955843 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:20.956296 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:20.970197 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] HTTP exception thrown: Instance b8328773-645f-4acb-aad8-2984c3b13211 could not be found. Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Request method failure captured: Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 HTTP/1.1 Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CQG8HWeNfiOq8aQUdKHghkL1T74BE2NK7glrno7hGRP54QGm9BSgGXmwXMs2E-pxWIdN3TMzPYtwdXcoJv4iZlV4avk6LOr7rxtXGI_UiurrLxxb7ejEy2_TxfEYaUxoqyNtg7kEOL-rgzugQdbzNpgJOhNTsdgyZKuJDgq9Bx2eU Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:33:20.971856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc049ff85c14935a9f68be76cd61c05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}] Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 0248519bf5b54ce3ba3b40f2c9a4c628 Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance b8328773-645f-4acb-aad8-2984c3b13211 could not be found. Sep 12 23:33:20.973499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'b8328773-645f-4acb-aad8-2984c3b13211'} Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8328773-645f-4acb-aad8-2984c3b13211 could not be found. Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:33:20.974412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8328773-645f-4acb-aad8-2984c3b13211 could not be found. Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8328773-645f-4acb-aad8-2984c3b13211 could not be found. Sep 12 23:33:20.975981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:20.977612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Returning 404 to user: Instance b8328773-645f-4acb-aad8-2984c3b13211 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:33:20.977612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-89727e04-bd85-4963-873c-8678d6890a04 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211" status: 404 len: 111 microversion: 2.1 time: 0.031054 Sep 12 23:33:20.977612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 330/665] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:20 2022] GET /compute/v2.1/servers/b8328773-645f-4acb-aad8-2984c3b13211 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:33:20.982947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c50a994b-e7da-45b1-ae0c-ec37e73a06fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '.version_select at 0x7fa4b380c9d0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:21.001914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c50a994b-e7da-45b1-ae0c-ec37e73a06fc tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833672688" status: 202 len: 0 microversion: 2.1 time: 0.023720 Sep 12 23:33:21.002462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 336/666] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Sep 12 23:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833672688 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:33:21.012976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:21.013667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:21.019699 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:21.020182 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:21.020664 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:21.021334 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:21.021791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:21.022211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:21.206899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:21.217333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:21.218893 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:21.220385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-75d1dfc6-2e42-4f14-8cb7-ce5802fa6229 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.211234 Sep 12 23:33:21.221117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 331/667] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:21 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:22.247510 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:22.248265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:22.256814 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:22.257927 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:22.258367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:22.259056 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:22.259513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:22.259962 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:22.389259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:22.397218 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:22.398658 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:22.399845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-950ce84b-8712-4d9c-8ce4-882caa371877 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.156805 Sep 12 23:33:22.400390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 337/668] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:22 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:23.425469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:23.426071 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:23.433421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:23.433896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:23.434324 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:23.435019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:23.435450 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:23.435896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:23.561836 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:23.569898 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:23.571461 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:23.572655 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-398c647b-5a3e-4ee0-89fc-133747fb51ab tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.151137 Sep 12 23:33:23.573214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 332/669] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:23 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:24.141762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:24.142264 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:24.149382 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:24.149868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:24.150307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:24.151281 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:24.151785 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:24.152208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:24.176497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:33:24.249304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-22631864-1c9c-4b23-b262-99e0e6e5cc1c tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 204 len: 0 microversion: 2.1 time: 0.111068 Sep 12 23:33:24.249965 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 338/670] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:33:24 2022] DELETE /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:33:24.258767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:24.259376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:24.265348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:24.265828 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:24.266262 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:24.266946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:24.267395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:24.267868 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:24.402761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:24.410312 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-404ab2c6-f266-4953-af57-6b8b3e2171ea tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1508 microversion: 2.1 time: 0.155985 Sep 12 23:33:24.410867 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 333/671] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:24 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:24.597675 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:24.598283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:24.604708 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:24.605183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:24.605612 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:24.606282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:24.606727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:24.607147 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:24.742527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:24.750418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:24.751862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:24.753001 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cb17860c-1afe-4213-a2ab-f84a32f7f200 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.159606 Sep 12 23:33:24.753558 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 339/672] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:24 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:25.433596 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:25.434319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:25.440788 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:25.441266 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:25.441724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:25.442403 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:25.442849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:25.443271 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:25.462156 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:25.571310 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:25.578879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ace1cd80-7aa1-48fb-9cb3-1410f97b7b26 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1508 microversion: 2.1 time: 0.149262 Sep 12 23:33:25.579442 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 334/673] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:25 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:25.778532 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:25.779074 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:25.785492 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:25.785975 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:25.786408 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:25.787091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:25.787539 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:25.787983 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:25.915857 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:25.923997 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:25.925431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:25.926582 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3af6a1c5-b92a-4953-bd9f-ceb3b476cf3f tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.152240 Sep 12 23:33:25.927136 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 340/674] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:25 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:26.603118 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:26.603755 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:26.610148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:26.610625 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:26.611058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:26.611800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:26.612247 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:26.612663 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:26.827414 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:26.836102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4d6d9446-1438-4b27-8240-2c98f8b6e981 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 200 len: 1508 microversion: 2.1 time: 0.237235 Sep 12 23:33:26.836671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 335/675] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:26 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:26.951610 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:26.952216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:26.958546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:26.959021 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:26.959452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:26.960153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:26.960728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:26.961677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:27.081863 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-509e4f63-729a-4990-9e13-45057ba560b0 req-aec9e627-d0a0-4511-829a-297b1945659c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a461aa66-7b30-46ee-a5d1-2a48540d585a", "name": "network-vif-deleted", "tag": "1a3abf75-9e9d-4acc-9edb-526d5e849d0e"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:27.097204 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-509e4f63-729a-4990-9e13-45057ba560b0 req-aec9e627-d0a0-4511-829a-297b1945659c service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:27.098001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-509e4f63-729a-4990-9e13-45057ba560b0 req-aec9e627-d0a0-4511-829a-297b1945659c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:27.098788 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-509e4f63-729a-4990-9e13-45057ba560b0 req-aec9e627-d0a0-4511-829a-297b1945659c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:27.104137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:27.112549 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:27.113960 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:27.115152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5d6ffd84-b7df-458d-acc6-1c8de168b918 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.167507 Sep 12 23:33:27.116075 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-509e4f63-729a-4990-9e13-45057ba560b0 req-aec9e627-d0a0-4511-829a-297b1945659c service nova] Creating event network-vif-deleted:1a3abf75-9e9d-4acc-9edb-526d5e849d0e for instance a461aa66-7b30-46ee-a5d1-2a48540d585a on hv-cinder-85200 Sep 12 23:33:27.122137 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-509e4f63-729a-4990-9e13-45057ba560b0 req-aec9e627-d0a0-4511-829a-297b1945659c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046806 Sep 12 23:33:27.123524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 336/676] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:27.133739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 341/677] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:26 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:27.859285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:27.860022 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: a461aa66-7b30-46ee-a5d1-2a48540d585a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:27.866335 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:27.866851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:27.867813 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:27.868499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:27.868952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:27.869384 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:27.882306 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] HTTP exception thrown: Instance a461aa66-7b30-46ee-a5d1-2a48540d585a could not be found. Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Request method failure captured: Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a HTTP/1.1 Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CQG8HWeNfiOq8aQUdKHghkL1T74BE2NK7glrno7hGRP54QGm9BSgGXmwXMs2E-pxWIdN3TMzPYtwdXcoJv4iZlV4avk6LOr7rxtXGI_UiurrLxxb7ejEy2_TxfEYaUxoqyNtg7kEOL-rgzugQdbzNpgJOhNTsdgyZKuJDgq9Bx2eU Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:33:27.883887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc049ff85c14935a9f68be76cd61c05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}] Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 0248519bf5b54ce3ba3b40f2c9a4c628 Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance a461aa66-7b30-46ee-a5d1-2a48540d585a could not be found. Sep 12 23:33:27.885429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'a461aa66-7b30-46ee-a5d1-2a48540d585a'} Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a461aa66-7b30-46ee-a5d1-2a48540d585a could not be found. Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:33:27.886351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a461aa66-7b30-46ee-a5d1-2a48540d585a could not be found. Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a461aa66-7b30-46ee-a5d1-2a48540d585a could not be found. Sep 12 23:33:27.887879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:27.889328 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Returning 404 to user: Instance a461aa66-7b30-46ee-a5d1-2a48540d585a could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:33:27.889328 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-db9c204a-10a8-40f6-8e9e-352889c298ec tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a" status: 404 len: 111 microversion: 2.1 time: 0.030664 Sep 12 23:33:27.889328 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 337/678] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:27 2022] GET /compute/v2.1/servers/a461aa66-7b30-46ee-a5d1-2a48540d585a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:33:27.893508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:27.894005 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:27.899923 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:27.900397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:27.901093 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:27.901777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:27.902234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:27.902658 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:27.931097 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:33:27.944802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:28.005510 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-297c4d7a-8dce-4a6b-a6ba-a2afb96ffa92 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 204 len: 0 microversion: 2.1 time: 0.115383 Sep 12 23:33:28.006308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 342/679] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:33:27 2022] DELETE /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:33:28.015074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:28.015803 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:28.021622 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:28.022100 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:28.022527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:28.023850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:28.024344 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:28.024841 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:28.141505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:28.142120 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:28.148681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:28.149045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:28.149532 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:28.150208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:28.150968 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:28.151400 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:28.159767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:28.168943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-80b2dd52-b1bf-4038-8a87-b788595c8141 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.157875 Sep 12 23:33:28.169498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 338/680] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:28 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:28.280916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:28.289554 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:28.291005 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:28.292295 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8fb17311-f087-401c-ae54-95886da2921c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.155128 Sep 12 23:33:28.292852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 343/681] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:28 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:33:29.191082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:29.191680 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:29.198127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:29.198609 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:29.199079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:29.199800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:29.200254 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:29.200682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:29.317799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:29.318411 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:29.325677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:29.326170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:29.326607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:29.327390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:29.328259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:29.329055 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:29.329486 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:29.339603 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ced7c1ec-639b-4a68-bd0a-efcbee63e42f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.152538 Sep 12 23:33:29.340189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 339/682] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:29 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:29.460600 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:29.468520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:29.469959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:29.471107 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0abae2e7-5ee0-4050-a95f-9324062a27c9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.157251 Sep 12 23:33:29.471678 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 344/683] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:29 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:30.362896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:30.363539 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:30.370507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:30.370990 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:30.371426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:30.372150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:30.372608 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:30.373028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:30.496996 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:30.497580 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:30.501978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:30.503902 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:30.504367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:30.504792 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:30.505471 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:30.505913 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:30.506325 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:30.510280 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-12463e3b-2aa4-476a-b91e-e730ad7d7d9f tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1523 microversion: 2.1 time: 0.151218 Sep 12 23:33:30.510845 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 340/684] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:30 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:30.633711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:30.641603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:30.643042 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:30.644212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-38af5d26-b277-409f-96b6-db2b18f87964 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.151147 Sep 12 23:33:30.644777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 345/685] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:30 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:33:31.532804 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:31.533405 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:31.547027 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:31.547528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:31.547989 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:31.548688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:31.549307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:31.549730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:31.633208 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0248519bf5b54ce3ba3b40f2c9a4c628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc049ff85c14935a9f68be76cd61c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:31.641377 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-658c67b4-982f-476b-8253-526e6cda7762 tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 200 len: 1481 microversion: 2.1 time: 0.112397 Sep 12 23:33:31.641946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 341/686] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:31 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 1481 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:31.651169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-a8ba7f13-f21c-4a01-ab0f-8d110ca02654 req-b59118f6-192d-4105-bad5-98c201891ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1398a779-68bf-4ec4-b196-d359ee0e7b8c", "name": "network-vif-deleted", "tag": "3bbf415e-a5cc-43c6-bf78-c5caf098ad4d"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:31.661417 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a8ba7f13-f21c-4a01-ab0f-8d110ca02654 req-b59118f6-192d-4105-bad5-98c201891ebd service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:31.661935 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a8ba7f13-f21c-4a01-ab0f-8d110ca02654 req-b59118f6-192d-4105-bad5-98c201891ebd service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:31.662409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a8ba7f13-f21c-4a01-ab0f-8d110ca02654 req-b59118f6-192d-4105-bad5-98c201891ebd service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:31.670484 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:31.671106 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:31.673747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-a8ba7f13-f21c-4a01-ab0f-8d110ca02654 req-b59118f6-192d-4105-bad5-98c201891ebd service nova] Creating event network-vif-deleted:3bbf415e-a5cc-43c6-bf78-c5caf098ad4d for instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c on hv-cinder-85200 Sep 12 23:33:31.678771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-a8ba7f13-f21c-4a01-ab0f-8d110ca02654 req-b59118f6-192d-4105-bad5-98c201891ebd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032378 Sep 12 23:33:31.679373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 346/687] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:31.681402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:31.682120 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:31.682587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:31.683558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:31.684205 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:31.684636 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:31.824313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:31.832768 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:31.834227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:31.836963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cf241f6d-b461-4467-841f-9fc9fb336b2d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.171545 Sep 12 23:33:31.837514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 342/688] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:31 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:32.325330 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:32.326090 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:32.332926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:32.333412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:32.333848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:32.334533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:32.334986 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:32.335410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:32.358252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-db0f31b3-e15d-4ad8-ae88-e22f0cb6b1c8 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/ips" status: 200 len: 146 microversion: 2.1 time: 0.089178 Sep 12 23:33:32.358809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 347/689] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:33:32 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/ips => generated 146 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:32.668630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:32.669395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] [instance: 1398a779-68bf-4ec4-b196-d359ee0e7b8c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:32.675697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:32.676173 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:32.676600 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:32.677274 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:32.677721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:32.678133 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:32.691382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] HTTP exception thrown: Instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c could not be found. Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Request method failure captured: Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c HTTP/1.1 Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CQG8HWeNfiOq8aQUdKHghkL1T74BE2NK7glrno7hGRP54QGm9BSgGXmwXMs2E-pxWIdN3TMzPYtwdXcoJv4iZlV4avk6LOr7rxtXGI_UiurrLxxb7ejEy2_TxfEYaUxoqyNtg7kEOL-rgzugQdbzNpgJOhNTsdgyZKuJDgq9Bx2eU Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:33:32.692903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc049ff85c14935a9f68be76cd61c05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc049ff85c14935a9f68be76cd61c05"}]}] Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: adc049ff85c14935a9f68be76cd61c05 Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1372401982 Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 0248519bf5b54ce3ba3b40f2c9a4c628 Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1372401982-project Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c could not be found. Sep 12 23:33:32.694926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '1398a779-68bf-4ec4-b196-d359ee0e7b8c'} Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c could not be found. Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:33:32.695731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c could not be found. Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c could not be found. Sep 12 23:33:32.696935 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:33:32.698039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] Returning 404 to user: Instance 1398a779-68bf-4ec4-b196-d359ee0e7b8c could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:33:32.698039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3e48abe3-1baa-435b-a58f-6a4a68ddee5a tempest-ServerRescueNegativeTestJSON-1372401982 tempest-ServerRescueNegativeTestJSON-1372401982-project] 10.222.0.27 "GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c" status: 404 len: 111 microversion: 2.1 time: 0.030631 Sep 12 23:33:32.698039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 343/690] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:32 2022] GET /compute/v2.1/servers/1398a779-68bf-4ec4-b196-d359ee0e7b8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:33:32.862674 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:32.863400 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:32.870966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:32.871484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:32.872055 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:32.872832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:32.873271 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:32.873693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:33.100820 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:33.111383 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:33.113907 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:33.115102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-deb836fe-1922-4e8f-9872-611854b7e4c4 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.256546 Sep 12 23:33:33.115688 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 348/691] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:32 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:33.699763 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6646526-fceb-486b-bd8d-4bf7fdbe4014"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:33.702167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:33.708736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:33.709217 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:33.709644 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:33.710332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:33.710783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:33.711202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:33.994128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5616e84b-87c6-415d-86fa-43ff6f7baaec tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298221 Sep 12 23:33:33.995681 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 344/692] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:33:33 2022] POST /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:34.141698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:34.143726 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:34.151657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:34.152278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:34.152579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:34.153283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:34.153734 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:34.154165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:34.362991 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:34.371450 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:34.372946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:34.374358 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-800e54c5-de7b-4e48-bd85-be14df6ae6e5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1746 microversion: 2.20 time: 0.236794 Sep 12 23:33:34.374911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 349/693] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:34 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1746 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:35.402267 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:35.402949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:35.409020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:35.409497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:35.409924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:35.410602 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:35.411058 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:35.411464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:35.626487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:35.635280 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:35.636745 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:35.637831 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0ee01371-ac4f-4cb8-9cd0-b67921a05a14 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1746 microversion: 2.20 time: 0.240610 Sep 12 23:33:35.638381 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 345/694] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:35 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1746 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:36.667092 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:36.667748 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:36.674299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:36.674789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:36.675381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:36.676273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:36.676938 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:36.677521 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:36.860995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:36.870444 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:36.873302 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:36.874716 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-20a07247-e492-4817-a3e0-027f82e519c2 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.215238 Sep 12 23:33:36.875780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 350/695] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:36 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:37.904723 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:37.905338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:37.913384 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:37.914655 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:37.915346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:37.916288 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:37.916962 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:37.917546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:38.081640 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:38.092706 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:38.095498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:38.097352 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1d08a3d1-a9bc-431a-aedb-c2c9d0be32ae tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.199613 Sep 12 23:33:38.098117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 346/696] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:37 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:38.908042 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-a4ee79c7-a2ba-4b04-ad07-fb0ba330c7e5 req-a5fb4783-e8e5-4e0a-b13c-3760028c4197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835d0938-03f8-42b8-b626-831891902172", "name": "network-vif-plugged", "status": "completed", "tag": "0caf572f-5337-4893-9c4d-eaccaf716b83"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:38.924192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a4ee79c7-a2ba-4b04-ad07-fb0ba330c7e5 req-a5fb4783-e8e5-4e0a-b13c-3760028c4197 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:38.924668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a4ee79c7-a2ba-4b04-ad07-fb0ba330c7e5 req-a5fb4783-e8e5-4e0a-b13c-3760028c4197 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:38.926920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-a4ee79c7-a2ba-4b04-ad07-fb0ba330c7e5 req-a5fb4783-e8e5-4e0a-b13c-3760028c4197 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:38.964429 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-a4ee79c7-a2ba-4b04-ad07-fb0ba330c7e5 req-a5fb4783-e8e5-4e0a-b13c-3760028c4197 service nova] Creating event network-vif-plugged:0caf572f-5337-4893-9c4d-eaccaf716b83 for instance 835d0938-03f8-42b8-b626-831891902172 on hv-cinder-85200 Sep 12 23:33:38.972988 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-a4ee79c7-a2ba-4b04-ad07-fb0ba330c7e5 req-a5fb4783-e8e5-4e0a-b13c-3760028c4197 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069669 Sep 12 23:33:38.976366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 351/697] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:39.122898 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:39.124359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:39.131770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:39.132524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:39.133186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:39.134212 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:39.134896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:39.135592 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:39.297792 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:39.309721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:39.323982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:39.325682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-14b192ee-1b17-4088-9502-5355382b38f3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.206584 Sep 12 23:33:39.329708 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 347/698] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:39 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:40.355419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:40.356164 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:40.364521 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.365310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.365920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.367514 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.368314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.368905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.650983 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:40.658617 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:40.660258 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:40.662598 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:40.664819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:40.666237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c7649361-a050-4155-b06a-86f4d0a12315 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.315584 Sep 12 23:33:40.667168 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 352/699] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:40 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:33:40.669759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.670656 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.671103 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.671837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.672435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.672997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.705365 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:40.707617 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:40.713794 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:40.715856 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.716933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.717527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:33:40.717712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.718707 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.719177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.719646 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.753119 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-02adcad2-b994-47ec-8e79-532764efa7b2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051380 Sep 12 23:33:40.754097 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 353/700] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:33:40 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:33:40.765842 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:40.766544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:40.773431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.774207 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.775033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.776310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.777167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.777745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.815094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-332e04f3-a1c8-4653-b0bc-b59e4ed7dc38 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/f6646526-fceb-486b-bd8d-4bf7fdbe4014" status: 200 len: 194 microversion: 2.1 time: 0.053360 Sep 12 23:33:40.815990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 354/701] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Sep 12 23:33:40 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/f6646526-fceb-486b-bd8d-4bf7fdbe4014 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:40.853855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e2681c8e-ebfb-4324-a919-99ff75e24db8 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "DELETE /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 204 len: 0 microversion: 2.1 time: 0.199195 Sep 12 23:33:40.858253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 348/702] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:33:40 2022] DELETE /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:33:40.864397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:40.864397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:40.872032 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.872528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.872961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:40.873651 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:40.874102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:40.877540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:41.101801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:41.110565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d3523427-5d69-4dba-afa6-7c57fdba537a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1578 microversion: 2.1 time: 0.251542 Sep 12 23:33:41.123777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 355/703] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:40 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1578 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:33:41.709652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:41.712471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:41.721466 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:41.722282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:41.723253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:41.727085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:41.728455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:41.729202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:41.925602 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:41.939123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:41.941141 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:41.942624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-97efac1f-a23c-45eb-97eb-b8dbcf352bdd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.240846 Sep 12 23:33:41.943763 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 349/704] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:41 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:42.135777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:42.136368 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:42.151058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:42.151803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:42.152041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:42.152717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:42.153175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:42.153592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:42.362139 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:42.374620 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-fcc13b93-38f9-49e7-983f-318ada618822 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1578 microversion: 2.1 time: 0.242953 Sep 12 23:33:42.378065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 356/705] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:42 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:42.408220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bc06cd4-f8a7-4f16-af8a-bd553c3fb00a"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:42.410730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:42.422251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:42.423783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:42.424486 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:42.425211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:42.425671 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:42.426105 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:42.430972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:42.822195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c397473e-71a2-4c69-9c8d-950c710effb7 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "POST /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418558 Sep 12 23:33:42.837381 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 350/706] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:33:42 2022] POST /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:42.972997 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:42.973831 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:42.982688 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:42.984205 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:42.985523 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:42.986458 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:42.987137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:42.987579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:43.218191 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:43.228880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:43.230567 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:43.231975 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2ff5bad8-af82-4e9c-abd2-a32a601c1640 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.263812 Sep 12 23:33:43.251746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 357/707] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:42 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:43.405301 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:43.406282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:43.408659 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:43.419706 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:43.420555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:43.421251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:43.422076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:43.422601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:43.423119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:43.528361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:43.539811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c289e808-3407-4217-8ce4-5842ee863198 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1511 microversion: 2.1 time: 0.138979 Sep 12 23:33:43.541132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 351/708] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:43 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1511 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:43.898778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-748ce1ac-0bae-4fa6-9d88-272fafd6a60d req-27888c9d-ca6b-4172-a196-69aa85e89947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712d2ca0-8999-4499-854b-b80c8cff71cf", "name": "network-vif-deleted", "tag": "5ac5e83f-2775-42c0-9cd0-314f2df0bbaa"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:43.913829 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-748ce1ac-0bae-4fa6-9d88-272fafd6a60d req-27888c9d-ca6b-4172-a196-69aa85e89947 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:43.914452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-748ce1ac-0bae-4fa6-9d88-272fafd6a60d req-27888c9d-ca6b-4172-a196-69aa85e89947 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:43.914961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-748ce1ac-0bae-4fa6-9d88-272fafd6a60d req-27888c9d-ca6b-4172-a196-69aa85e89947 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:43.944482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-748ce1ac-0bae-4fa6-9d88-272fafd6a60d req-27888c9d-ca6b-4172-a196-69aa85e89947 service nova] Creating event network-vif-deleted:5ac5e83f-2775-42c0-9cd0-314f2df0bbaa for instance 712d2ca0-8999-4499-854b-b80c8cff71cf on hv-cinder-85200 Sep 12 23:33:43.944482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-748ce1ac-0bae-4fa6-9d88-272fafd6a60d req-27888c9d-ca6b-4172-a196-69aa85e89947 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289370 Sep 12 23:33:43.944482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 358/709] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:44.260645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:44.261926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:44.273877 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:44.274619 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:44.281548 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:44.282413 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:44.283046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:44.283648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:44.482117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:44.493397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:44.495451 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:44.497563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-74534273-1d45-4e43-83d3-f2db60f379a5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.241965 Sep 12 23:33:44.499177 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 352/710] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:44 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:44.565751 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:44.567407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:44.582067 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:44.582935 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:44.583857 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:44.586507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:44.587624 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:44.588318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:44.652892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:44.653472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:44.653984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:44.654509 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lazy-loading 'fault' on Instance uuid 712d2ca0-8999-4499-854b-b80c8cff71cf {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:33:44.721684 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:44.732697 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e2e7446b-c5d3-4727-b340-5459783cb0c7 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 200 len: 1231 microversion: 2.1 time: 0.172525 Sep 12 23:33:44.734346 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 359/711] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:44 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 1231 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:45.527140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:45.527871 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:45.535242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:45.535764 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:45.536206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:45.536906 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:45.537360 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:45.538403 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:45.691879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:45.701701 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:45.703307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:45.704713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b6a39fbb-80b9-4f8f-851c-db9717e5e971 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.182357 Sep 12 23:33:45.705946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 353/712] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:45 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:45.760933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:45.762477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:45.769068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:45.769555 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:45.769981 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:45.770820 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:45.771293 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:45.771740 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:45.777242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:45.789595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] HTTP exception thrown: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Request method failure captured: Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf HTTP/1.1 Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8EOwQouIPY7j8fm3ZX_1yIZ9C1lz3bj8er-4vZnMxrZmLbzfvNfwmbsYlYPHt9oCEqhl_UF4hDEPu4j3Sz416WydC7vglrUy639_4IIUo0Ujjzb3uabstNhUpz4zDFqZWwE_JjCqYpYy3OK7N8wwkMk6Tr7xZcy6r9LVkIfloWPUGQ Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:33:45.791882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaa5d21fc40540e4b811713e5efeff46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}] Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 2d62232282dc4455834857d5290eb169 Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:33:45.793505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '712d2ca0-8999-4499-854b-b80c8cff71cf'} Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:33:45.794307 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:33:45.796342 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:33:45.797520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Returning 404 to user: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:33:45.797520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6c915169-983d-44a9-b4ab-282cfb75ea14 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 404 len: 111 microversion: 2.1 time: 0.037101 Sep 12 23:33:45.810428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 360/713] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:45 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:33:45.901152 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1533284278", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1903603689", "security_groups": [{"name": "tempest-secgroup-smoke-575282427"}], "block_device_mapping_v2": [{"uuid": "72d26c7f-4abc-474f-8344-2f06052f95d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eca586cf-58eb-48f2-bcf7-9aa793fb9bf1"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:46.060526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] validate_networks() for [('eca586cf-58eb-48f2-bcf7-9aa793fb9bf1', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:33:46.698565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:33:46.699124 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:33:46.699539 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:33:46.700623 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:33:46.701258 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:33:46.712412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:46.713222 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:46.713744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:46.714551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:46.715112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:46.715638 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:46.733657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:46.734245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for project eaa5d21fc40540e4b811713e5efeff46. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:33:46.734809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:46.739354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for user 2d62232282dc4455834857d5290eb169 and project eaa5d21fc40540e4b811713e5efeff46. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:33:46.743172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:46.743689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:46.744125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:46.744952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:46.745442 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:46.745865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:46.804917 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:33:46.807284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d26c7f-4abc-474f-8344-2f06052f95d8',volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:33:46.901456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:46.940703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:46.942642 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:46.944513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0ac559e1-48a6-4aa8-b7ed-b194ed441338 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.214734 Sep 12 23:33:46.948158 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 361/714] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:46 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:33:46.985191 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ee405573-49a5-4165-a648-1e1394d1c6c2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.088755 Sep 12 23:33:46.986245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 354/715] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:33:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:33:46.998060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5da3758e-754f-453a-bac8-6fb51bb6ae87 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:46.998925 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5da3758e-754f-453a-bac8-6fb51bb6ae87 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:47.070062 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5da3758e-754f-453a-bac8-6fb51bb6ae87 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:47.077779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5da3758e-754f-453a-bac8-6fb51bb6ae87 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1095 microversion: 2.1 time: 0.083033 Sep 12 23:33:47.093102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 362/716] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:46 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1095 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:47.973512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:47.974120 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:47.980861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:47.981522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:47.981948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:47.982802 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:47.983403 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:47.984123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:48.101135 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:48.101750 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:48.109542 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:48.110033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:48.110901 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:48.111165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:48.111644 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:48.112163 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:48.130629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:48.140763 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:48.142300 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:48.143532 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f4b7fdfe-9091-4135-a670-ecef05bef832 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.174439 Sep 12 23:33:48.144194 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 355/717] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:47 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:48.185179 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:48.193216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a0539f3c-4ac0-477e-933b-f2fb8fa2e7bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1145 microversion: 2.1 time: 0.096675 Sep 12 23:33:48.194104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 363/718] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:48 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:33:49.168248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:49.168849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:49.175145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:49.175646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:49.176076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:49.177009 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:49.177450 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:49.177864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:49.216065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:49.216675 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:49.223070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:49.223552 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:49.224013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:49.224702 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:49.225153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:49.225571 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:49.287834 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:49.295439 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0a116d04-bb97-4ca6-94b8-915db00416e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1145 microversion: 2.1 time: 0.083135 Sep 12 23:33:49.296035 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 364/719] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:49 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:33:49.314325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:49.322396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:49.323849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:49.325009 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fe73f581-f4d7-4ec2-b01c-54040d9f0270 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.160704 Sep 12 23:33:49.325551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 356/720] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:49 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:50.324049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:50.324910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:50.331212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:50.331731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:50.332165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:50.332848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:50.333298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:50.333760 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:50.351701 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:50.352458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:50.358931 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:50.359408 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:50.359868 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:50.360547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:50.360995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:50.361418 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:50.405995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:50.421914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-03edf52f-a929-41a2-833c-f4717ec2f9a6 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1193 microversion: 2.1 time: 0.103000 Sep 12 23:33:50.423052 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 365/721] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:50 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:50.540127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:50.549481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:50.551125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:50.552322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5654b3b2-0ff3-4bb5-8f78-5b675c410edf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1741 microversion: 2.20 time: 0.205606 Sep 12 23:33:50.552884 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 357/722] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:50 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:51.447388 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:51.448816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:51.457248 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.458123 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.458813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.461729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.462300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.462973 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.576694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:51.579275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:51.580943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:51.591551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-31b24c12-c791-4fbf-8ea8-1830ea52f6fc tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1211 microversion: 2.1 time: 0.148614 Sep 12 23:33:51.592392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.593063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.593469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 366/723] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:51 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:51.593880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.594889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.595746 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.596349 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.625382 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:51.630602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:51.638547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.639172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.639891 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.640962 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.641711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.642250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.682273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e961b34c-6fec-4613-ba8b-508e051ff305 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062214 Sep 12 23:33:51.682959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 367/724] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:33:51 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:51.792426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:51.793023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:51.800703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.800973 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.801667 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.802616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.803974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.804632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.837665 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c7a31f76-6b37-49e6-8be0-b715a79f1772 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/f6646526-fceb-486b-bd8d-4bf7fdbe4014" status: 200 len: 194 microversion: 2.1 time: 0.049255 Sep 12 23:33:51.838432 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 368/725] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Sep 12 23:33:51 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/f6646526-fceb-486b-bd8d-4bf7fdbe4014 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:33:51.849220 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:51.849860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:51.857349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.858009 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.858515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.859310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:51.859878 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:51.860376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:51.955961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lazy-loading 'services' on Instance uuid 985bbb7e-d077-499f-ba1b-70b1191389d3 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:33:52.032273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a15a80e3-7d80-4e20-9147-e1e75c50e0e2 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/f6646526-fceb-486b-bd8d-4bf7fdbe4014" status: 202 len: 0 microversion: 2.1 time: 0.186964 Sep 12 23:33:52.033053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 369/726] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:33:51 2022] DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/f6646526-fceb-486b-bd8d-4bf7fdbe4014 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:33:52.055316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:52.063536 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:52.065109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:52.066119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c42a418f-6f2b-45ca-a7d2-fe0a4fdb983d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1723 microversion: 2.20 time: 0.492490 Sep 12 23:33:52.066744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 358/727] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:51 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:52.618223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:52.619447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:52.626173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:52.626656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:52.627082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:52.628020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:52.628469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:52.629065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:52.847922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-94a2fb7e-a332-495d-b4b1-13fab2dec33b req-25d5458d-5ff8-4995-aabf-33f8de771a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835d0938-03f8-42b8-b626-831891902172", "name": "network-vif-unplugged", "status": "completed", "tag": "0caf572f-5337-4893-9c4d-eaccaf716b83"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:52.880353 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-94a2fb7e-a332-495d-b4b1-13fab2dec33b req-25d5458d-5ff8-4995-aabf-33f8de771a74 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:52.881590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-94a2fb7e-a332-495d-b4b1-13fab2dec33b req-25d5458d-5ff8-4995-aabf-33f8de771a74 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:52.882385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-94a2fb7e-a332-495d-b4b1-13fab2dec33b req-25d5458d-5ff8-4995-aabf-33f8de771a74 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:52.898780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-94a2fb7e-a332-495d-b4b1-13fab2dec33b req-25d5458d-5ff8-4995-aabf-33f8de771a74 service nova] Creating event network-vif-unplugged:0caf572f-5337-4893-9c4d-eaccaf716b83 for instance 835d0938-03f8-42b8-b626-831891902172 on hv-cinder-85200 Sep 12 23:33:52.905710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-94a2fb7e-a332-495d-b4b1-13fab2dec33b req-25d5458d-5ff8-4995-aabf-33f8de771a74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.210216 Sep 12 23:33:52.911692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 359/728] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:33:52.930914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:52.943819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-06ee0430-7c2e-45b4-8c79-750e7bf7814d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1278 microversion: 2.1 time: 0.330302 Sep 12 23:33:52.944426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 370/729] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:52 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:53.093069 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:53.097127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:53.117355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:53.119054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:53.124662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:53.126164 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:53.126891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:53.128808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:53.330216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:53.340590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:53.343146 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:53.344608 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f9ccc4c1-7275-42c7-a031-793b9cb53ce9 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1726 microversion: 2.20 time: 0.255912 Sep 12 23:33:53.345847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 360/730] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:53 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1726 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:53.373554 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a8fbe2-a817-4949-9cf2-8b124ad22162"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:53.377789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:53.385270 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:53.386201 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:53.386805 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:53.387724 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:53.388335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:53.389297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:53.732298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e185ab3c-2949-4961-a60d-982c55e0cd68 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.364455 Sep 12 23:33:53.734319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 371/731] 10.222.0.27 () {62 vars in 1364 bytes} [Mon Sep 12 23:33:53 2022] POST /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-volume_attachments => generated 188 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:33:53.927494 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:53.928668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:53.936759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:53.937326 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:53.937837 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:53.938548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:53.939667 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:53.940100 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.033772 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-1f04dc78-9b86-4013-9969-31cceadb4c77 req-5fb60d6f-441c-4109-8dcc-9cb118ed1920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37c4155-6a32-4c60-94f9-542d3beac5bd", "tag": "e122a07d-d119-4a70-9133-63ec543a476e"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:54.044086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1f04dc78-9b86-4013-9969-31cceadb4c77 req-5fb60d6f-441c-4109-8dcc-9cb118ed1920 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.044697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1f04dc78-9b86-4013-9969-31cceadb4c77 req-5fb60d6f-441c-4109-8dcc-9cb118ed1920 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.045257 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1f04dc78-9b86-4013-9969-31cceadb4c77 req-5fb60d6f-441c-4109-8dcc-9cb118ed1920 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.060629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-1f04dc78-9b86-4013-9969-31cceadb4c77 req-5fb60d6f-441c-4109-8dcc-9cb118ed1920 service nova] Creating event network-changed:e122a07d-d119-4a70-9133-63ec543a476e for instance f37c4155-6a32-4c60-94f9-542d3beac5bd on hv-cinder-85200 Sep 12 23:33:54.074400 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-1f04dc78-9b86-4013-9969-31cceadb4c77 req-5fb60d6f-441c-4109-8dcc-9cb118ed1920 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388063 Sep 12 23:33:54.075273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 361/732] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:54.080213 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:54.080892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:54.088974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.090226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.090829 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.092166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.092621 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.093042 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.241070 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=6,nova_cell1:UPDATE=7 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:54.245436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2d5f0344-57c7-427a-b445-739fe0736319 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-volume_attachments/09a8fbe2-a817-4949-9cf2-8b124ad22162" status: 202 len: 0 microversion: 2.20 time: 0.322963 Sep 12 23:33:54.246591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 372/733] 10.222.0.27 () {60 vars in 1457 bytes} [Mon Sep 12 23:33:53 2022] DELETE /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-volume_attachments/09a8fbe2-a817-4949-9cf2-8b124ad22162 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:33:54.251616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:54.263547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e290eaca-d607-4224-9c62-3feb68950090 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.187064 Sep 12 23:33:54.267470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:54.285625 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 362/734] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:54 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:54.286806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:54.295156 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.295808 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.296393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.297091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.297537 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.297953 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.316284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:54.316878 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:54.323084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.323595 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.324028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.324880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.325341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.325816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.335845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-54eee95e-8999-42c3-bc8d-baf2d7a2a835 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/9bc06cd4-f8a7-4f16-af8a-bd553c3fb00a" status: 200 len: 194 microversion: 2.1 time: 0.087931 Sep 12 23:33:54.336903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 373/735] 10.222.0.27 () {58 vars in 1413 bytes} [Mon Sep 12 23:33:54 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/9bc06cd4-f8a7-4f16-af8a-bd553c3fb00a => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:54.347183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:54.347707 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:54.354251 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.354933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.355527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.356605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.357339 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.357918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.377001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120621) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 23:33:54.451818 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lazy-loading 'services' on Instance uuid 985bbb7e-d077-499f-ba1b-70b1191389d3 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:33:54.456003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4d4776ec-329e-4bc7-830a-02630d5b1352 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "POST /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/action" status: 202 len: 0 microversion: 2.20 time: 0.143376 Sep 12 23:33:54.456669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 363/736] 10.222.0.27 () {62 vars in 1319 bytes} [Mon Sep 12 23:33:54 2022] POST /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 12 23:33:54.464681 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:54.465297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:54.472024 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.472581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.473450 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.475360 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:54.476051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:54.476923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:54.551928 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2f4e1b2a-3f79-44eb-ad52-11988d9ea283 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/9bc06cd4-f8a7-4f16-af8a-bd553c3fb00a" status: 202 len: 0 microversion: 2.1 time: 0.208034 Sep 12 23:33:54.552591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 374/737] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:33:54 2022] DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments/9bc06cd4-f8a7-4f16-af8a-bd553c3fb00a => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:33:54.722741 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:54.731794 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:54.733420 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:54.734823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9ac6e9e5-6f04-461d-bc78-3b048fd4dff3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1674 microversion: 2.20 time: 0.273857 Sep 12 23:33:54.735833 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 364/738] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:54 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1674 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:33:55.294503 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:55.295251 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:55.302789 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.303547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.304176 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.305207 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.306124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.306742 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.536706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:55.548939 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-32e1a05b-ee15-4433-98ff-4712f7a14d6d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.259345 Sep 12 23:33:55.560794 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 375/739] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:55 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:55.733917 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:55.736212 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:55.742717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.743192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.743649 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.744334 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.744829 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.745244 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.762643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:55.763447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:55.769441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.769926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.770353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.771212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.772684 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.773025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.776159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-828e3a3b-ea69-4e60-b12f-eb8c51d183ed tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045907 Sep 12 23:33:55.779097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 365/740] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:33:55 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:33:55.925531 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:55.927782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:55.934061 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.934749 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.935558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.936970 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:55.937431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:55.937858 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:55.957693 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:55.973868 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-65aeceb9-2742-479d-b0e8-da19077d9172 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063488 Sep 12 23:33:55.979711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 366/741] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:33:55 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:33:56.035007 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:56.043252 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:56.044943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:56.046110 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dcfd8ae9-2c46-4f0a-b215-873486d436cf tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.287290 Sep 12 23:33:56.046669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 376/742] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:55 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:33:56.057642 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:56.058406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:56.064669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:56.065154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:56.065912 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:56.067516 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:56.068909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:56.069537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:56.098186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:33:56.188713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2529e966-37ee-4ac1-896b-358e46d6067f tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 204 len: 0 microversion: 2.1 time: 0.135709 Sep 12 23:33:56.189455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 367/743] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:33:56 2022] DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:33:56.201365 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:56.203005 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:56.210146 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:56.211413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:56.212074 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:56.212978 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:56.213432 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:56.213912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:56.348923 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:56.356909 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-06943107-af4f-47ba-91d9-080539dec0fd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1674 microversion: 2.1 time: 0.163040 Sep 12 23:33:56.357490 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 377/744] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:56 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:56.573402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:56.574316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:56.581175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:56.581849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:56.582292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:56.582984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:56.583439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:56.583894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:56.725383 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:56.740176 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:56.748889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9135a989-15e6-47f0-a549-f3c9dd9ff95e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.179692 Sep 12 23:33:56.749491 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 368/745] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:56 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:57.076002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:57.076527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:57.078466 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:57.083799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:57.084778 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:57.085210 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:57.085892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:57.086344 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:57.086764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:57.218555 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:57.230327 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:57.231780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:57.232922 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d03c5770-97d7-4bae-ac51-e24d6be1fd6c tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.160981 Sep 12 23:33:57.233474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 378/746] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:57 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:33:57.381422 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:57.381952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:57.383782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:33:57.389055 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:57.389528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:57.389965 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:57.390652 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:57.391100 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:57.391525 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:57.520930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:57.530080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-925724b8-7e4a-4123-abb8-15b0562691bc tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1674 microversion: 2.1 time: 0.153081 Sep 12 23:33:57.530644 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 369/747] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:57 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:57.771166 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:57.771887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:57.779615 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:57.780268 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:57.780880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:57.781744 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:57.782230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:57.782822 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:58.245247 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:58.256235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a2ecef44-12c4-4375-a30a-fdc0f2e48fca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.488230 Sep 12 23:33:58.257237 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:58.257698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 379/748] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:57 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:58.265196 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:58.277948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:58.278445 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:58.278963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:58.279715 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:58.280164 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:58.283374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:58.487536 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:58.497267 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:58.498849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:58.501086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6d9d72bf-3a17-493b-9101-3f4bdca4538d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.248142 Sep 12 23:33:58.501551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 370/749] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:58 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:33:58.553840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:58.554457 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:58.563118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:58.564088 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:58.564662 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:58.565951 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:58.567338 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:58.568152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:58.657796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:58.669031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-89ba8b8f-daed-4e05-bdcf-f62b5234ee6d tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.119435 Sep 12 23:33:58.669606 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 380/750] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:58 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:58.939496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-01041ba5-ffad-484f-b814-3074a67a443a req-0da3bee1-03cc-401f-ab31-8d2c0816e0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985bbb7e-d077-499f-ba1b-70b1191389d3", "name": "network-vif-deleted", "tag": "a6f30f79-4144-4a51-a80a-931cea883d79"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:33:58.956366 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-01041ba5-ffad-484f-b814-3074a67a443a req-0da3bee1-03cc-401f-ab31-8d2c0816e0c6 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:58.960984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-01041ba5-ffad-484f-b814-3074a67a443a req-0da3bee1-03cc-401f-ab31-8d2c0816e0c6 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:58.962599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-01041ba5-ffad-484f-b814-3074a67a443a req-0da3bee1-03cc-401f-ab31-8d2c0816e0c6 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:58.982791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-01041ba5-ffad-484f-b814-3074a67a443a req-0da3bee1-03cc-401f-ab31-8d2c0816e0c6 service nova] Creating event network-vif-deleted:a6f30f79-4144-4a51-a80a-931cea883d79 for instance 985bbb7e-d077-499f-ba1b-70b1191389d3 on hv-cinder-85200 Sep 12 23:33:58.989986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-01041ba5-ffad-484f-b814-3074a67a443a req-0da3bee1-03cc-401f-ab31-8d2c0816e0c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062277 Sep 12 23:33:58.992187 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 371/751] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:33:59.280745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:59.281511 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:59.291097 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:59.294289 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:59.294930 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:59.296154 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:59.297203 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:59.298461 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:59.530208 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:59.532450 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:59.543472 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:59.546488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:59.547208 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:59.547842 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:59.549548 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:59.550525 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:59.551898 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:59.561029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0127310c-9e73-44ca-9a50-56e9475fd8b3 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.276981 Sep 12 23:33:59.561841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 381/752] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:59 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:59.705124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:33:59.707225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:33:59.731819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:59.732431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:59.733003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:59.735113 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:33:59.735730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:33:59.736990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:33:59.911948 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:59.921434 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-fe487f87-3553-4010-891a-3c79699102d3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.230839 Sep 12 23:33:59.922632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 382/753] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:33:59 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:33:59.952725 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:59.961155 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:59.962872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:33:59.964279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3e27ac13-d1c8-4a0e-a09c-8b01f47bbe73 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.439933 Sep 12 23:33:59.968113 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 372/754] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:33:59 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:00.590651 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:00.592100 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:00.608995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:00.609731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:00.612326 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:00.613426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:00.614043 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:00.618018 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:00.857272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:00.866006 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2e2a06d9-a4eb-4b99-aabd-a8604ea8397b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.280546 Sep 12 23:34:00.867547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 383/755] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:00 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:00.948521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:00.949929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:00.956971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:00.957776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:00.958417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:00.959471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:00.960162 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:00.960773 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:00.998030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:00.999053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:01.008145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:01.011444 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:01.012116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:01.013030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:01.013700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:01.014329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:01.071600 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:01.082235 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-be4d961b-6851-41ed-946b-a1754ba8c199 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.138889 Sep 12 23:34:01.086035 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 373/756] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:00 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:01.249510 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:01.259940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:01.262313 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:01.263889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a2a78655-4b0f-4739-aa49-486d643be4c5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.270310 Sep 12 23:34:01.264885 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 384/757] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:00 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:01.891691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:01.892648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:01.900803 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:01.901380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:01.901847 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:01.902547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:01.903255 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:01.903899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:02.091065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:02.100991 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-afb72ffc-b732-4339-af35-6fcd30a7a67d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.213400 Sep 12 23:34:02.101956 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 374/758] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:01 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:02.109470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:02.110200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:02.117864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:02.118436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:02.119592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:02.120371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:02.120978 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:02.121561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:02.205864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:02.216408 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6061e4cc-d0e6-4bf3-8de5-dfb17faaa8b9 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.110981 Sep 12 23:34:02.217148 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 385/759] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:02 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:02.290375 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:02.291309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:02.297962 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:02.301426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:02.301875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:02.303244 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:02.303736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:02.304209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:02.458447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:02.468490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:02.470286 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:02.471462 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-25e6b694-9e41-45c0-8710-565b33c6ff65 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.185040 Sep 12 23:34:02.472520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 375/760] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:02 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:03.125641 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:03.126196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:03.141866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.142364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.142878 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.143613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.144068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.144482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.240793 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:03.244340 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:03.251308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.252177 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.252820 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.253754 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.254413 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.255051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.334681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:03.345071 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-212759f2-101d-4f65-bbc8-1a8f1850d6eb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.222400 Sep 12 23:34:03.345957 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 386/761] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:03 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:03.368158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:03.379535 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2df3b841-36a4-41fa-9cf9-967586b0a3da tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.140552 Sep 12 23:34:03.380277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 376/762] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:03 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:03.499860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:03.501128 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:03.507920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.508469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.508904 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.510224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.510695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.511118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.703051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:03.703506 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:03.710724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.711222 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.711818 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.712511 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.713141 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.714365 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.750192 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lazy-loading 'flavor' on Instance uuid 6c0ad905-fb81-48ab-9712-10d8badbd7f6 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:34:03.810695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:03.830318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:03.832320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:03.833858 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f738d046-592a-49d6-bd3d-80fb16052d08 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.338087 Sep 12 23:34:03.835262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 387/763] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:03 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:03.879844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a459f9ff-be68-44dd-b08f-9038e9ec7fe2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "POST /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6/action" status: 202 len: 0 microversion: 2.1 time: 0.182133 Sep 12 23:34:03.881457 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 377/764] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:34:03 2022] POST /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:34:03.891229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:03.892094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:03.901676 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.902329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.903095 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:03.904176 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:03.904842 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:03.905485 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:04.111553 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:04.114423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:04.121893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a3e3f14c-4666-4aa6-92a8-0afff58282cc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.234802 Sep 12 23:34:04.123121 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 388/765] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:03 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:04.373082 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:04.373840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:04.380948 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:04.381427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:04.381855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:04.382634 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:04.383179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:04.383690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:04.403487 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:04.404731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:04.416837 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:04.417773 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:04.418445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:04.419172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:04.422335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:04.422841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:04.504704 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:04.528197 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-62ee2334-01cb-4d5b-9d47-0d8051a6b2cd tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.128566 Sep 12 23:34:04.529463 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 389/766] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:04 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:04.636792 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:04.647155 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-79b6fdbc-6ac1-4ea5-8dcd-5c2e831141ff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.277287 Sep 12 23:34:04.648160 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 378/767] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:04 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:04.876082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:04.876696 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:04.882671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:04.883156 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:04.883617 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:04.884464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:04.884967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:04.885416 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:05.123278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:05.135010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:05.136910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:05.138304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8c842b14-24b2-4a17-9507-7f3e67a80a1a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.266639 Sep 12 23:34:05.139322 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 390/768] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:04 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:05.148825 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:05.150402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:05.159670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:05.160611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:05.161305 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:05.162103 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:05.162567 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:05.171147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:05.391452 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:05.398292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4125ff5b-6bce-4e9e-bda5-22714b5a0568 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.255818 Sep 12 23:34:05.399132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 379/769] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:05 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:05.554165 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:05.554886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:05.567204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:05.568639 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:05.569391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:05.570668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:05.571293 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:05.572512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:05.659971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:05.672165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:05.672781 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:05.675911 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-abcce52f-9e76-44fe-ba2a-f04b76671bd3 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.125524 Sep 12 23:34:05.679978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:05.680683 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:05.681826 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:05.682712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:05.683317 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:05.683918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:05.690755 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 391/770] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:05 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:05.691527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:05.872740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:05.885685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-25df712d-18c7-4c7e-b5ce-03d505778287 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.217244 Sep 12 23:34:05.887794 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 380/771] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:05 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:06.168436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:06.169047 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:06.189094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.189591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.190225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:06.191628 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.192253 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.193496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:06.357590 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:06.366961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:06.368553 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:06.369799 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ec9e040a-30bb-4355-be98-4d564f0d8adc tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.205183 Sep 12 23:34:06.370364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 392/772] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:06 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:06.422347 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:06.422961 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:06.430521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.431711 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.432148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:06.432906 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.433273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.433691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:06.578149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:06.586054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-30433538-de8c-4016-bf1b-8f3fbf554aff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.167617 Sep 12 23:34:06.586647 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 381/773] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:06 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:06.700456 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:06.700950 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:06.706847 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.707368 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.707829 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:06.708512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.708965 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.709385 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:06.773412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:06.781795 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cfd7fae7-7cbd-4df2-b575-962fa1a6f09c tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1606 microversion: 2.1 time: 0.085098 Sep 12 23:34:06.782243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 393/774] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:06 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:06.914780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:06.915562 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:06.922579 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.923068 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.923522 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:06.924364 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:06.924819 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:06.925242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.063984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:07.071704 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8baeee2f-e7a4-4192-89b1-467ab4dbf592 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.160710 Sep 12 23:34:07.072268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 382/775] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:06 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:07.395664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:07.397353 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:07.403584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:07.404068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:07.404506 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.405195 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:07.405880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:07.406332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.546356 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:07.554601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:07.556052 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:07.557214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3c5d15e7-7f33-4682-8af0-43785df00a2b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.166178 Sep 12 23:34:07.557749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 394/776] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:07 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:07.608619 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:07.609224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:07.615759 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:07.616242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:07.616678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.617359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:07.617808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:07.618228 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.747927 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:07.756012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3a09bcf5-6fc4-48f0-b3a4-2ec1925e8062 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.150742 Sep 12 23:34:07.756568 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 383/777] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:07 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:07.804673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:07.805286 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:07.811721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:07.812211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:07.812652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.813340 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:07.813795 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:07.814224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.844866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:07.845344 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:07.845781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:07.846220 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lazy-loading 'fault' on Instance uuid 985bbb7e-d077-499f-ba1b-70b1191389d3 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:34:07.888830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f56dde21c754cfe8253ec5c1b7b90d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ffe803ce4b4d0181be62e1dfb094bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:07.897082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1426693c-5032-465f-baa2-69480dcf2f77 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 200 len: 1327 microversion: 2.1 time: 0.096216 Sep 12 23:34:07.897644 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 395/778] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:07 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:08.094231 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:08.094762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:08.100710 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.101198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.101615 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.102285 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.102730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.103142 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.241372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:08.246245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9b515637-2795-415c-9014-b9b72108635e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.155797 Sep 12 23:34:08.246887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 384/779] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:08 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:08.582174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:08.582782 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:08.588672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.589163 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.589599 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.590264 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.590712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.591130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.745917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:08.756892 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:08.758976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:08.760826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c740572c-ea3a-4ba4-bbd1-b621c2715ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.182396 Sep 12 23:34:08.761897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 396/780] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:08 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:08.786888 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:08.788487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:08.794760 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.795241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.795692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.796379 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.796813 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.797401 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.930720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:08.931933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:08.940018 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.941282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.941724 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.942419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:08.943061 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:08.943482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:08.958060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] HTTP exception thrown: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Request method failure captured: Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 HTTP/1.1 Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CKTzEgBjPYpywSweb1rz1OpcSEkYED0pK_quHqmC9yeb9kWsN2G0LxLWyjJAOh3pzpmoSP3XPaOkvX-jsnKTcR7kb-twO1uzehLMdSuA9B9xjH3ISrDFvV8rBsW9iy855X7xQmtmIOTsBf1chDAUKJsi77IZuJcV7DsFOtvPRQroU Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:34:08.960547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8ffe803ce4b4d0181be62e1dfb094bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}] Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 7f56dde21c754cfe8253ec5c1b7b90d7 Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:08.962058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '985bbb7e-d077-499f-ba1b-70b1191389d3'} Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:08.962954 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:08.964694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:08.968059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Returning 404 to user: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:08.969408 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cd891816-3a35-49fb-b7d6-15dfe728af15 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 404 len: 111 microversion: 2.1 time: 0.045089 Sep 12 23:34:08.970390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 397/781] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:08 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:34:08.974738 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:08.979934 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c8e7e711-018c-4bad-8836-608f48a0f46e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '.version_select at 0x7fa4b36bae50>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:08.998570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7e83ee12-fa1a-4033-b06d-075f2bef0aa2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.215870 Sep 12 23:34:09.003302 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 385/782] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:08 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:09.013994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c8e7e711-018c-4bad-8836-608f48a0f46e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457400543" status: 202 len: 0 microversion: 2.1 time: 0.038477 Sep 12 23:34:09.014581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 398/783] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Sep 12 23:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1457400543 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:34:09.277424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:09.278597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:09.292720 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:09.292836 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:09.293631 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:09.294581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:09.295310 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:09.295887 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:09.502898 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:09.511494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-93bde866-ed7e-473f-9f78-4eeb1a63c22f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.241683 Sep 12 23:34:09.512353 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 386/784] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:09 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:09.789490 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:09.790534 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:09.792424 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:09.798170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:09.798729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:09.799162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:09.800006 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:09.800329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:09.800742 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:09.932388 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:09.941412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:09.943112 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:09.944961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cefedf8c-8554-43d0-85ac-5af6258a070e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.159839 Sep 12 23:34:09.945580 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 399/785] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:09 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:10.028220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:10.028874 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:10.032229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:10.036013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:10.036498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:10.036930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:10.037615 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:10.038066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:10.038488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:10.171745 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:10.180248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-71b2ab7a-b6cd-400d-9489-f39bfe1ca8aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.156016 Sep 12 23:34:10.180751 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 387/786] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:10 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:10.534343 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:10.535228 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:10.541132 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:10.541617 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:10.542045 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:10.542827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:10.543632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:10.543733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:10.711369 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:10.719809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0f4dd78d-c899-42cb-b84b-328978e857b1 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.189244 Sep 12 23:34:10.721134 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 400/787] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:10 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:10.978944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:10.978944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:10.980789 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:10.981425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:10.981866 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:10.982571 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:10.983050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:10.983483 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:11.018571 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-3c1f2edd-313c-434c-baf9-6b5fb00f5578 req-1bc74b40-08ab-40c7-8abd-462c4f25bc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37c4155-6a32-4c60-94f9-542d3beac5bd", "name": "network-vif-plugged", "status": "completed", "tag": "e122a07d-d119-4a70-9133-63ec543a476e"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:11.034721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-3c1f2edd-313c-434c-baf9-6b5fb00f5578 req-1bc74b40-08ab-40c7-8abd-462c4f25bc57 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:11.038512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-3c1f2edd-313c-434c-baf9-6b5fb00f5578 req-1bc74b40-08ab-40c7-8abd-462c4f25bc57 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:11.039064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-3c1f2edd-313c-434c-baf9-6b5fb00f5578 req-1bc74b40-08ab-40c7-8abd-462c4f25bc57 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:11.056560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-3c1f2edd-313c-434c-baf9-6b5fb00f5578 req-1bc74b40-08ab-40c7-8abd-462c4f25bc57 service nova] Creating event network-vif-plugged:e122a07d-d119-4a70-9133-63ec543a476e for instance f37c4155-6a32-4c60-94f9-542d3beac5bd on hv-cinder-85200 Sep 12 23:34:11.062695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-3c1f2edd-313c-434c-baf9-6b5fb00f5578 req-1bc74b40-08ab-40c7-8abd-462c4f25bc57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048860 Sep 12 23:34:11.063298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 401/788] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:34:11.156377 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:11.166694 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:11.168610 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:11.169994 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-80a1d351-e623-485e-87dd-7c80dbb6ab9e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.203571 Sep 12 23:34:11.170732 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 388/789] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:10 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:11.205446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:11.206451 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:11.214873 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:11.217160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:11.217777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:11.229616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:11.230291 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:11.230910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:11.393230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:11.405325 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8c641cf6-ffb5-4242-b105-93f9d4cc7104 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.205260 Sep 12 23:34:11.406633 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 402/790] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:11 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:11.744317 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:11.745320 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:11.751497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:11.752026 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:11.752528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:11.753227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:11.753715 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:11.754162 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:11.889203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:11.897399 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7bf7ef74-840e-46d5-95f5-fde806f069bb tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1266 microversion: 2.1 time: 0.156920 Sep 12 23:34:11.897968 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 389/791] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:11 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:12.011480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:12.012013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:12.017984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.018470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.018913 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.019625 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.020084 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.020562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.035318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] HTTP exception thrown: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Request method failure captured: Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 HTTP/1.1 Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CKTzEgBjPYpywSweb1rz1OpcSEkYED0pK_quHqmC9yeb9kWsN2G0LxLWyjJAOh3pzpmoSP3XPaOkvX-jsnKTcR7kb-twO1uzehLMdSuA9B9xjH3ISrDFvV8rBsW9iy855X7xQmtmIOTsBf1chDAUKJsi77IZuJcV7DsFOtvPRQroU Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:34:12.037040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8ffe803ce4b4d0181be62e1dfb094bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}] Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 7f56dde21c754cfe8253ec5c1b7b90d7 Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.038373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '985bbb7e-d077-499f-ba1b-70b1191389d3'} Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:12.039151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.040998 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.044226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Returning 404 to user: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:12.044226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a9cc7dcf-0884-4f88-bc59-6a4f5ffd791e tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 404 len: 111 microversion: 2.1 time: 0.030740 Sep 12 23:34:12.044226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 403/792] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:34:12 2022] DELETE /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:34:12.050946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:12.051558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: 985bbb7e-d077-499f-ba1b-70b1191389d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:12.058861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.059348 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.059849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.060549 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.061005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.061431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.075602 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] HTTP exception thrown: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Request method failure captured: Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 HTTP/1.1 Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CKTzEgBjPYpywSweb1rz1OpcSEkYED0pK_quHqmC9yeb9kWsN2G0LxLWyjJAOh3pzpmoSP3XPaOkvX-jsnKTcR7kb-twO1uzehLMdSuA9B9xjH3ISrDFvV8rBsW9iy855X7xQmtmIOTsBf1chDAUKJsi77IZuJcV7DsFOtvPRQroU Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:34:12.077292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8ffe803ce4b4d0181be62e1dfb094bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}] Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 7f56dde21c754cfe8253ec5c1b7b90d7 Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.078900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '985bbb7e-d077-499f-ba1b-70b1191389d3'} Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:12.079844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. Sep 12 23:34:12.081211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:12.082299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Returning 404 to user: Instance 985bbb7e-d077-499f-ba1b-70b1191389d3 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:12.082299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9e2ac07b-cd26-42f2-8214-a45f0f0fffb1 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3" status: 404 len: 111 microversion: 2.1 time: 0.035544 Sep 12 23:34:12.082439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 390/793] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:12 2022] GET /compute/v2.1/servers/985bbb7e-d077-499f-ba1b-70b1191389d3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:34:12.196634 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:12.197245 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:12.203322 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.203893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.204539 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.205073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.205520 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.206282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.345768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:12.355717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:12.357413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:12.359140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-78e568dd-6d64-42ac-8908-69dc2701a00d tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.167317 Sep 12 23:34:12.359853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 404/794] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:12 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:12.429414 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:12.430135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:12.436160 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.436721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.437230 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.438012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.438542 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.439045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.612765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:12.624119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3b7b6001-710e-4ba2-b439-98349ac450e0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.198784 Sep 12 23:34:12.624703 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 391/795] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:12 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:12.926880 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:12.927493 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:12.935916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.936933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.937549 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:12.938422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:12.938881 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:12.939897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.084066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:13.088591 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-0cf1246f-f0b3-4af8-9fd0-f65f80a8d665 req-b3fe60b7-4f94-4ac5-b5fc-3f67485b695e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835d0938-03f8-42b8-b626-831891902172", "name": "network-vif-plugged", "status": "completed", "tag": "0caf572f-5337-4893-9c4d-eaccaf716b83"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:13.093547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-64bb3aee-4808-4d7d-89be-5919cf1f0dc2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1453 microversion: 2.1 time: 0.170543 Sep 12 23:34:13.094306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 405/796] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:12 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:13.115982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0cf1246f-f0b3-4af8-9fd0-f65f80a8d665 req-b3fe60b7-4f94-4ac5-b5fc-3f67485b695e service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.116730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0cf1246f-f0b3-4af8-9fd0-f65f80a8d665 req-b3fe60b7-4f94-4ac5-b5fc-3f67485b695e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.117109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0cf1246f-f0b3-4af8-9fd0-f65f80a8d665 req-b3fe60b7-4f94-4ac5-b5fc-3f67485b695e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.122290 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:13.123025 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:13.128965 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-0cf1246f-f0b3-4af8-9fd0-f65f80a8d665 req-b3fe60b7-4f94-4ac5-b5fc-3f67485b695e service nova] Creating event network-vif-plugged:0caf572f-5337-4893-9c4d-eaccaf716b83 for instance 835d0938-03f8-42b8-b626-831891902172 on hv-cinder-85200 Sep 12 23:34:13.133928 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.134598 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.135339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-0cf1246f-f0b3-4af8-9fd0-f65f80a8d665 req-b3fe60b7-4f94-4ac5-b5fc-3f67485b695e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049740 Sep 12 23:34:13.135485 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.136178 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.136379 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 392/797] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:13.137073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.137728 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.230407 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:13.231294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:13.238370 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.239208 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.240186 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.240384 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.241002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.241612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.277363 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] HTTP exception thrown: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Request method failure captured: Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef HTTP/1.1 Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CKTzEgBjPYpywSweb1rz1OpcSEkYED0pK_quHqmC9yeb9kWsN2G0LxLWyjJAOh3pzpmoSP3XPaOkvX-jsnKTcR7kb-twO1uzehLMdSuA9B9xjH3ISrDFvV8rBsW9iy855X7xQmtmIOTsBf1chDAUKJsi77IZuJcV7DsFOtvPRQroU Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:34:13.279076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8ffe803ce4b4d0181be62e1dfb094bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}] Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 7f56dde21c754cfe8253ec5c1b7b90d7 Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.280730 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'bbaafcd0-103d-4e1a-a15e-fc8997acceef'} Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:13.281646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.283126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.285225 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Returning 404 to user: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:13.286297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b8e43d98-4880-4b0c-a867-bfef015ae114 tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 404 len: 111 microversion: 2.1 time: 0.060406 Sep 12 23:34:13.287472 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 393/798] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:34:13 2022] DELETE /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:34:13.295726 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:13.296601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] [instance: bbaafcd0-103d-4e1a-a15e-fc8997acceef] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:13.303385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.304205 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.304808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.305690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.306355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.306938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.326367 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] HTTP exception thrown: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Request method failure captured: Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef HTTP/1.1 Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CKTzEgBjPYpywSweb1rz1OpcSEkYED0pK_quHqmC9yeb9kWsN2G0LxLWyjJAOh3pzpmoSP3XPaOkvX-jsnKTcR7kb-twO1uzehLMdSuA9B9xjH3ISrDFvV8rBsW9iy855X7xQmtmIOTsBf1chDAUKJsi77IZuJcV7DsFOtvPRQroU Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:34:13.330670 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8ffe803ce4b4d0181be62e1dfb094bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8ffe803ce4b4d0181be62e1dfb094bf"}]}] Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: b8ffe803ce4b4d0181be62e1dfb094bf Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeTestJSON-379678266 Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 7f56dde21c754cfe8253ec5c1b7b90d7 Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeTestJSON-379678266-project Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.333070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'bbaafcd0-103d-4e1a-a15e-fc8997acceef'} Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:13.334358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. Sep 12 23:34:13.335553 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:13.338135 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] Returning 404 to user: Instance bbaafcd0-103d-4e1a-a15e-fc8997acceef could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:13.340332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1cfb097b-7ff1-4026-b8d5-c798d6df315a tempest-AttachVolumeTestJSON-379678266 tempest-AttachVolumeTestJSON-379678266-project] 10.222.0.27 "GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef" status: 404 len: 111 microversion: 2.1 time: 0.048807 Sep 12 23:34:13.341396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 394/799] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:13 2022] GET /compute/v2.1/servers/bbaafcd0-103d-4e1a-a15e-fc8997acceef => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:34:13.355933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:13.372935 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6f91b4c8-7448-4a34-9cc1-380385333aff tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1453 microversion: 2.1 time: 0.256699 Sep 12 23:34:13.386499 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 406/800] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:13 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1453 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:13.396107 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:13.396107 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:13.409068 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.410794 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.411252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.412226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.412690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.417629 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.607388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:13.617527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:13.619079 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:13.620359 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d5f3ab70-ef5e-4c20-80e7-876af37769c3 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.236178 Sep 12 23:34:13.620983 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 395/801] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:13 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:13.652303 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:13.653075 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:13.659445 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.660107 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.660629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.661581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:13.662040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:13.662463 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:13.987959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:14.002111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-51c0e1c3-209e-4a94-bc17-ee72a4bacc60 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.353782 Sep 12 23:34:14.015595 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 407/802] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:13 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:14.648159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:14.650136 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:14.662931 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:14.663822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:14.666905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:14.668253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:14.669191 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:14.671023 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:14.874240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:14.884817 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:14.891747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:14.894094 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-91cd6c10-878d-4481-93f3-519ed09332ea tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1732 microversion: 2.20 time: 0.251587 Sep 12 23:34:14.895104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 396/803] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:14 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:15.027378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:15.028166 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:15.034859 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:15.035259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:15.035792 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:15.036567 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:15.037027 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:15.037453 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:15.042601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=100 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:15.365310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:15.373107 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c401a75c-0f45-4c16-984a-e97969de9c22 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.349835 Sep 12 23:34:15.387388 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 408/804] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:15 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:15.928953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:15.929564 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:15.935925 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:15.936403 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:15.936838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:15.937532 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:15.937982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:15.938469 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:16.074241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:16.082776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:16.084803 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:16.086038 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7bee187a-9a59-458d-8923-deed3380411a tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1719 microversion: 2.20 time: 0.161476 Sep 12 23:34:16.086814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 397/805] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:15 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:34:16.397825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:16.398974 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:16.406363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:16.407066 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:16.407489 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:16.408366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:16.408800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:16.409214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:16.894441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:16.903507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-20a77e56-e5ca-4566-9694-5da91ad0bad4 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.510090 Sep 12 23:34:16.904373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 409/806] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:16 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:17.033829 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-6c6c6a19-d8d1-4610-bb53-567a39ab30b8 req-7852b7aa-3ef0-443b-9511-ebc304f4cf16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37c4155-6a32-4c60-94f9-542d3beac5bd", "tag": "e122a07d-d119-4a70-9133-63ec543a476e"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:17.047083 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6c6c6a19-d8d1-4610-bb53-567a39ab30b8 req-7852b7aa-3ef0-443b-9511-ebc304f4cf16 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:17.048410 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6c6c6a19-d8d1-4610-bb53-567a39ab30b8 req-7852b7aa-3ef0-443b-9511-ebc304f4cf16 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:17.049010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6c6c6a19-d8d1-4610-bb53-567a39ab30b8 req-7852b7aa-3ef0-443b-9511-ebc304f4cf16 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:17.064684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-6c6c6a19-d8d1-4610-bb53-567a39ab30b8 req-7852b7aa-3ef0-443b-9511-ebc304f4cf16 service nova] Creating event network-changed:e122a07d-d119-4a70-9133-63ec543a476e for instance f37c4155-6a32-4c60-94f9-542d3beac5bd on hv-cinder-85200 Sep 12 23:34:17.070526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-6c6c6a19-d8d1-4610-bb53-567a39ab30b8 req-7852b7aa-3ef0-443b-9511-ebc304f4cf16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041823 Sep 12 23:34:17.071714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 398/807] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:17.934848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:17.935421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:17.961383 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:17.961874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:17.962311 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:17.963012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:17.963462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:17.976094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:18.496768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:18.504711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-126988fe-6655-4f51-8eab-219e0ef0a061 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.575849 Sep 12 23:34:18.507531 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 410/808] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:17 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:19.535821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:19.537092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:19.544717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:19.545537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:19.545986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:19.546672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:19.547648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:19.548074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:19.696810 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:19.704810 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c781bd8d-1e80-4146-b145-424af7e885b9 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.174186 Sep 12 23:34:19.705373 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 399/809] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:19 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:20.729442 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:20.730053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:20.736681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:20.737214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:20.737695 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:20.738388 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:20.738873 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:20.739294 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:20.874490 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:20.884206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-50072dc0-3b8a-4e7f-bd69-94de064549b5 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1570 microversion: 2.1 time: 0.158517 Sep 12 23:34:20.885304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 411/810] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:20 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:20.911117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:20.911557 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:20.921888 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:20.922408 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:20.922814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:20.923513 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:20.923997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:20.924423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:20.940213 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:20.973022 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120621) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 23:34:21.046268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1b43d962-84e8-471b-a263-4a8f55c978fe tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "POST /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6/action" status: 202 len: 0 microversion: 2.1 time: 0.139481 Sep 12 23:34:21.047139 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 400/811] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:34:20 2022] POST /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:34:21.055366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:21.056701 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:21.064660 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:21.065347 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:21.065950 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:21.066860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:21.067345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:21.067852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:21.202808 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:21.211793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ade5a206-8ec6-4b39-9b7b-258c6e025de1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1518 microversion: 2.1 time: 0.160527 Sep 12 23:34:21.212364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 412/812] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:21 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:21.700688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-74cbc4c7-741c-4692-a93c-3b53826eeec2 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b3642700>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:21.750152 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-74cbc4c7-741c-4692-a93c-3b53826eeec2 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/962a3b03-1738-4330-80b1-aad815717f7d" status: 200 len: 350 microversion: 2.1 time: 0.053574 Sep 12 23:34:21.750800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 401/813] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:34:21 2022] GET /compute/v2.1/os-volumes/962a3b03-1738-4330-80b1-aad815717f7d => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:22.235410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:22.236261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:22.243644 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:22.244137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:22.244573 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:22.245399 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:22.245874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:22.246294 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:22.386114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:22.393757 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5d06ad4f-de98-4256-a49c-a97b47af74f1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1520 microversion: 2.1 time: 0.162427 Sep 12 23:34:22.394322 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 413/814] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:22 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:22.854682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-b4ead365-1ae9-4561-a38b-ff4c39c16167 req-51d1afdf-95ad-4f8e-8cd2-6a3fa1f868bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ad905-fb81-48ab-9712-10d8badbd7f6", "name": "network-vif-unplugged", "status": "completed", "tag": "6ccc2d74-2c48-49e0-b714-f319925458f8"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:22.865780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b4ead365-1ae9-4561-a38b-ff4c39c16167 req-51d1afdf-95ad-4f8e-8cd2-6a3fa1f868bd service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:22.866954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b4ead365-1ae9-4561-a38b-ff4c39c16167 req-51d1afdf-95ad-4f8e-8cd2-6a3fa1f868bd service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:22.867413 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b4ead365-1ae9-4561-a38b-ff4c39c16167 req-51d1afdf-95ad-4f8e-8cd2-6a3fa1f868bd service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:22.879957 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-b4ead365-1ae9-4561-a38b-ff4c39c16167 req-51d1afdf-95ad-4f8e-8cd2-6a3fa1f868bd service nova] Creating event network-vif-unplugged:6ccc2d74-2c48-49e0-b714-f319925458f8 for instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 on hv-cinder-85200 Sep 12 23:34:22.885765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-b4ead365-1ae9-4561-a38b-ff4c39c16167 req-51d1afdf-95ad-4f8e-8cd2-6a3fa1f868bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034644 Sep 12 23:34:22.886884 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 402/815] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:23.133822 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e4ab5dff-ee1f-41ac-972d-fca852244d00 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b366a040>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:23.182215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e4ab5dff-ee1f-41ac-972d-fca852244d00 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/7ed03e68-f436-443d-b5cf-91b875b59333" status: 200 len: 351 microversion: 2.1 time: 0.052170 Sep 12 23:34:23.182797 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 414/816] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:34:23 2022] GET /compute/v2.1/os-volumes/7ed03e68-f436-443d-b5cf-91b875b59333 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:34:23.419053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:23.419812 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:23.428678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:23.429172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:23.429601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:23.430294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:23.430741 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:23.431163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:23.635840 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:23.645783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0b3dc0ef-79cc-4558-8e4c-df1d4a8f9e04 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.230592 Sep 12 23:34:23.652224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 403/817] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:23 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:24.553224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e2213e9e-8af4-481a-82da-b2e7fad007c2 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b36a78b0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:24.599229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e2213e9e-8af4-481a-82da-b2e7fad007c2 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1aa06f0c-197c-4aca-b2f4-6920cb4eaff2" status: 200 len: 351 microversion: 2.1 time: 0.050945 Sep 12 23:34:24.599820 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 415/818] 10.222.0.27 () {58 vars in 1245 bytes} [Mon Sep 12 23:34:24 2022] GET /compute/v2.1/os-volumes/1aa06f0c-197c-4aca-b2f4-6920cb4eaff2 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:24.612558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3b6b39d9-df75-4d34-b5a3-f4f55f771e49 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b36ee8b0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:24.668422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:24.669032 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:24.677177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:24.677672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:24.678121 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:24.678810 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:24.679266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:24.679720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:24.695806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3b6b39d9-df75-4d34-b5a3-f4f55f771e49 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086938 Sep 12 23:34:24.696368 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 404/819] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Sep 12 23:34:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:24.710709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-73fb5156-1ce8-4bda-a1a9-de88052cfcfb tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b36c9a60>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:24.800174 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-73fb5156-1ce8-4bda-a1a9-de88052cfcfb tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093674 Sep 12 23:34:24.800743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 405/820] 10.222.0.27 () {58 vars in 1149 bytes} [Mon Sep 12 23:34:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:34:24.817290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85d404a1-b86c-4e36-9709-55c8b36c4961 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b39548b0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:24.830921 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:24.839233 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d78997d3-3df9-40fe-be00-8b0eff95bced tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.174504 Sep 12 23:34:24.839682 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 416/821] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:24 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:24.914822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85d404a1-b86c-4e36-9709-55c8b36c4961 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.103243 Sep 12 23:34:24.915703 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 406/822] 10.222.0.27 () {58 vars in 1134 bytes} [Mon Sep 12 23:34:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:24.931057 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-66359467-485f-4648-8424-3b2ffd7734e6 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b37ec310>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:25.014354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-66359467-485f-4648-8424-3b2ffd7734e6 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088488 Sep 12 23:34:25.014992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 417/823] 10.222.0.27 () {58 vars in 1167 bytes} [Mon Sep 12 23:34:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:25.028861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fade93f8-2668-4cba-9a09-c98f983b45e6 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b3642820>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:25.109766 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fade93f8-2668-4cba-9a09-c98f983b45e6 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084856 Sep 12 23:34:25.110337 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 407/824] 10.222.0.27 () {58 vars in 1170 bytes} [Mon Sep 12 23:34:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:25.124585 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9f9a3a07-fff6-46cb-9c9a-1d55de35bff7 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b366a940>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:25.206706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9f9a3a07-fff6-46cb-9c9a-1d55de35bff7 tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085823 Sep 12 23:34:25.207372 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 418/825] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Sep 12 23:34:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:25.220664 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cad78691-d505-4543-8562-1bdeed73470c tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b361f670>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:25.304284 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cad78691-d505-4543-8562-1bdeed73470c tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087329 Sep 12 23:34:25.304933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 408/826] 10.222.0.27 () {58 vars in 1188 bytes} [Mon Sep 12 23:34:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:25.318112 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e53bfba0-85bf-446f-863a-689ac793fe4d tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] Calling method '.version_select at 0x7fa4b367c670>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:25.398365 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e53bfba0-85bf-446f-863a-689ac793fe4d tempest-VolumesTestJSON-951446463 tempest-VolumesTestJSON-951446463-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083934 Sep 12 23:34:25.398925 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 419/827] 10.222.0.27 () {58 vars in 1155 bytes} [Mon Sep 12 23:34:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:25.863468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:25.864212 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:25.870517 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:25.871002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:25.871439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:25.872263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:25.872762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:25.873185 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:26.007998 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:26.015902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5e5d4127-0b3e-43c3-abeb-ece61260407c tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.156829 Sep 12 23:34:26.016462 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 409/828] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:25 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:27.039645 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:27.040440 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:27.047866 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:27.048349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:27.048777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:27.049455 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:27.049899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:27.050316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:27.178497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:27.186054 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-91425895-965a-482c-a304-942b29bfe109 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.151218 Sep 12 23:34:27.186613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 420/829] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:27 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:28.209449 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:28.210004 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:28.216420 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:28.216902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:28.217338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:28.218028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:28.218479 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:28.218905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:28.346801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:28.355063 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f8663ef5-2a6b-44db-b5ce-747b20d73cc2 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.150168 Sep 12 23:34:28.356089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 410/830] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:28 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:29.379175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:29.380823 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:29.387884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:29.388526 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:29.389212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:29.390030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:29.390568 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:29.391082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:29.584821 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:29.594000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8ea82de7-a9d2-43cd-982d-69ff951472ee tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.219524 Sep 12 23:34:29.594918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 421/831] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:29 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:34:30.623011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:30.623690 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:30.633105 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:30.634028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:30.634463 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:30.635240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:30.635714 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:30.636134 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:30.791692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:30.800268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-218b30a1-7e2e-45dc-af0d-f24f3f802829 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.182048 Sep 12 23:34:30.817106 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 411/832] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:30 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:31.823717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:31.824941 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:31.831482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:31.831982 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:31.832422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:31.833208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:31.834212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:31.834671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:31.975422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:31.985197 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-926789ba-d258-42ff-9dc4-b8b6dae3e3ff tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.165311 Sep 12 23:34:31.985795 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 422/833] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:31 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:32.982883 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-ccbf22b1-8d28-411a-98f3-404a159dfa59 req-9a8a48e6-40a8-413f-aaef-189d8ecb3245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ad905-fb81-48ab-9712-10d8badbd7f6", "name": "network-vif-plugged", "status": "completed", "tag": "6ccc2d74-2c48-49e0-b714-f319925458f8"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:32.996225 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ccbf22b1-8d28-411a-98f3-404a159dfa59 req-9a8a48e6-40a8-413f-aaef-189d8ecb3245 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:32.996932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ccbf22b1-8d28-411a-98f3-404a159dfa59 req-9a8a48e6-40a8-413f-aaef-189d8ecb3245 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:32.997731 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ccbf22b1-8d28-411a-98f3-404a159dfa59 req-9a8a48e6-40a8-413f-aaef-189d8ecb3245 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:33.009402 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:33.010783 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:33.023522 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:33.024663 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:33.025144 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:33.025946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:33.027000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:33.027437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:33.028051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-ccbf22b1-8d28-411a-98f3-404a159dfa59 req-9a8a48e6-40a8-413f-aaef-189d8ecb3245 service nova] Creating event network-vif-plugged:6ccc2d74-2c48-49e0-b714-f319925458f8 for instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 on hv-cinder-85200 Sep 12 23:34:33.033033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-ccbf22b1-8d28-411a-98f3-404a159dfa59 req-9a8a48e6-40a8-413f-aaef-189d8ecb3245 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054054 Sep 12 23:34:33.034325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 412/834] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:33.182886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:33.191003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cddcd63a-ebcd-4b95-9f1e-470b50bdac73 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.186241 Sep 12 23:34:33.191594 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 423/835] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:33 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:34.215541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:34.216874 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:34.224242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:34.225023 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:34.225791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:34.226675 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:34.227307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:34.228036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:34.411205 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:34.420330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1cb7b993-44b3-486c-ad16-7493facb87aa tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1576 microversion: 2.1 time: 0.209360 Sep 12 23:34:34.420905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 413/836] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:34 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:35.444896 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:35.446171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:35.452474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:35.452970 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:35.453410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:35.454111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:35.454879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:35.455306 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:35.647509 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:35.658193 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-889fe7bf-e694-4338-8552-54178dca3d0e tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1563 microversion: 2.1 time: 0.217646 Sep 12 23:34:35.659510 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 424/837] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:35 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1563 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:49.164921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:49.167801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:49.170335 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:49.171771 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:49.181033 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:49.181859 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:49.182515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:49.185932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:49.186565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:49.187156 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:49.221530 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8fabc246-4f19-4884-837b-b9015725294b tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061177 Sep 12 23:34:49.222854 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 414/838] 10.222.0.27 () {60 vars in 1343 bytes} [Mon Sep 12 23:34:49 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:49.303971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:49.304467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:49.306934 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=41 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:49.311739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=71 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:34:49.319893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:49.320627 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:49.321211 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:49.322081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:49.322693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:49.323332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:49.355519 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:34:49.472777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bd614107-54a6-44b9-aa5b-58f58c93d4ad tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 204 len: 0 microversion: 2.20 time: 0.172250 Sep 12 23:34:49.474196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 425/839] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Sep 12 23:34:49 2022] DELETE /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 23:34:49.482220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:49.482915 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:49.491433 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:49.494377 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:49.494944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:49.495753 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:49.496395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:49.497002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:49.652396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:49.662482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:49.663860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:49.665052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-da0757ff-d8bc-4ec9-aba0-5d7da5fd7ae5 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.186660 Sep 12 23:34:49.665602 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 415/840] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:49 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:50.696826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:50.697679 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:50.704600 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:50.705384 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:50.706043 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:50.706979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:50.707745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:50.708389 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:50.884659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:50.893731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:50.896672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:50.898371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4434435a-0ca7-44eb-a6e9-4dbd47f88359 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1725 microversion: 2.20 time: 0.207892 Sep 12 23:34:50.913425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 426/841] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:50 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:51.931404 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:51.937289 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:51.949783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:51.954458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:51.955837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:51.958997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:51.959684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:51.960195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:52.039285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-ef877ac4-5561-4418-a656-a3b295759440 req-ece6eac9-a141-4e42-b143-cf758657d471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835d0938-03f8-42b8-b626-831891902172", "name": "network-vif-deleted", "tag": "0caf572f-5337-4893-9c4d-eaccaf716b83"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:52.055940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ef877ac4-5561-4418-a656-a3b295759440 req-ece6eac9-a141-4e42-b143-cf758657d471 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:52.089200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ef877ac4-5561-4418-a656-a3b295759440 req-ece6eac9-a141-4e42-b143-cf758657d471 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:52.089657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ef877ac4-5561-4418-a656-a3b295759440 req-ece6eac9-a141-4e42-b143-cf758657d471 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:52.119850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:52.126309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-ef877ac4-5561-4418-a656-a3b295759440 req-ece6eac9-a141-4e42-b143-cf758657d471 service nova] Creating event network-vif-deleted:0caf572f-5337-4893-9c4d-eaccaf716b83 for instance 835d0938-03f8-42b8-b626-831891902172 on hv-cinder-85200 Sep 12 23:34:52.130487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:52.138702 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2749a61b3dd04d89a5c2e4235aa96934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa1c574bdd14a1bb0ae5f82f892e6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:52.145251 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-20bba612-67e5-4dd0-b127-78b47ecd1046 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 200 len: 1657 microversion: 2.20 time: 0.217003 Sep 12 23:34:52.147467 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-ef877ac4-5561-4418-a656-a3b295759440 req-ece6eac9-a141-4e42-b143-cf758657d471 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113997 Sep 12 23:34:52.155243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 427/842] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:34:52.165175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 416/843] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:51 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 1657 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:34:53.179232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:53.180114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:53.192632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:53.193130 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:53.193569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:53.194266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:53.194719 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:53.195142 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:53.216095 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] HTTP exception thrown: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Request method failure captured: Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 HTTP/1.1 Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CHhAHx0_QAUKRM8mT4BD5XqJvirD8qB2pAvBTk7n84lYObmDRceuuAnQcAzxv5N12PDfotan24lB7vQV_obX3asbiYVzqoAgMIKfXJ1J2eSDMJl-A28ufYuLzsDiTfuzNhvfsGQTCO59pi7baPR2i4XtF5FhPpBe0zQCa8YShwPV4 Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:34:53.218104 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aa1c574bdd14a1bb0ae5f82f892e6bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}] Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 2749a61b3dd04d89a5c2e4235aa96934 Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:53.219906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '835d0938-03f8-42b8-b626-831891902172'} Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:53.220910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:53.222579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:53.225381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Returning 404 to user: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:53.226616 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0a0773af-00d8-4b4c-ae93-a9b5758c6260 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 404 len: 111 microversion: 2.20 time: 0.052765 Sep 12 23:34:53.231106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 428/844] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:53 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:34:53.236371 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1d697490-e54f-4026-96c2-49b3433c7c55 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '.version_select at 0x7fa4b36ee3a0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:53.273358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1d697490-e54f-4026-96c2-49b3433c7c55 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552965095" status: 204 len: 0 microversion: 2.20 time: 0.041184 Sep 12 23:34:53.274528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 417/845] 10.222.0.27 () {60 vars in 1262 bytes} [Mon Sep 12 23:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552965095 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 23:34:55.313640 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:55.314681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:55.321841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:55.322317 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:55.322747 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:55.323423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:55.323900 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:55.324314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:55.337703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] HTTP exception thrown: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Request method failure captured: Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 HTTP/1.1 Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CHhAHx0_QAUKRM8mT4BD5XqJvirD8qB2pAvBTk7n84lYObmDRceuuAnQcAzxv5N12PDfotan24lB7vQV_obX3asbiYVzqoAgMIKfXJ1J2eSDMJl-A28ufYuLzsDiTfuzNhvfsGQTCO59pi7baPR2i4XtF5FhPpBe0zQCa8YShwPV4 Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:34:55.339629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aa1c574bdd14a1bb0ae5f82f892e6bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}] Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 2749a61b3dd04d89a5c2e4235aa96934 Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.341378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '835d0938-03f8-42b8-b626-831891902172'} Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:55.342292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.343865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.346059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Returning 404 to user: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:55.346888 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b81d516e-1179-4a5c-8e74-c89a1643684e tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 404 len: 111 microversion: 2.20 time: 0.037074 Sep 12 23:34:55.347418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 429/846] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Sep 12 23:34:55 2022] DELETE /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:34:55.356289 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:55.356925 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: 835d0938-03f8-42b8-b626-831891902172] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:55.365416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:55.365915 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:55.366512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:55.367241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:55.367763 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:55.368424 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:55.383012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] HTTP exception thrown: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Request method failure captured: Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 HTTP/1.1 Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CHhAHx0_QAUKRM8mT4BD5XqJvirD8qB2pAvBTk7n84lYObmDRceuuAnQcAzxv5N12PDfotan24lB7vQV_obX3asbiYVzqoAgMIKfXJ1J2eSDMJl-A28ufYuLzsDiTfuzNhvfsGQTCO59pi7baPR2i4XtF5FhPpBe0zQCa8YShwPV4 Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:34:55.384724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aa1c574bdd14a1bb0ae5f82f892e6bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}] Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 2749a61b3dd04d89a5c2e4235aa96934 Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.386165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '835d0938-03f8-42b8-b626-831891902172'} Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:55.386920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. Sep 12 23:34:55.388275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:55.390292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Returning 404 to user: Instance 835d0938-03f8-42b8-b626-831891902172 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:55.390292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c7c27862-a8c1-4e90-8e8e-258f803779eb tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172" status: 404 len: 111 microversion: 2.20 time: 0.034460 Sep 12 23:34:55.390292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 418/847] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:55 2022] GET /compute/v2.1/servers/835d0938-03f8-42b8-b626-831891902172 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:34:55.505016 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-74505aa6-2c33-410e-a0f4-66c9a6939e5a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Action: 'create', calling method: .version_select at 0x7fa4b3665af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-376892558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARNSrsZwugfjY1j97pkTCHehSTN4HIca2C7o6Ce6D1bUCFfaJ1/HeCB0m4LlcZ7ZUdDOolp/F8iRybEyuF7xkeK9Oe9e9Ld+eh4BvCfSNRc9FucARJXLL/41n3qKNoqTQ=="}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:55.519946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-74505aa6-2c33-410e-a0f4-66c9a6939e5a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Getting quotas for project 00950b4875f54197bf44bd1ffa353937. Resources: {'key_pairs'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:34:55.523658 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-74505aa6-2c33-410e-a0f4-66c9a6939e5a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Getting quotas for user dd6241594ed040ce85c4b017cc361894 and project 00950b4875f54197bf44bd1ffa353937. Resources: {'key_pairs'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:34:55.545344 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-74505aa6-2c33-410e-a0f4-66c9a6939e5a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044322 Sep 12 23:34:55.545838 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 430/848] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:34:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:34:55.644248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-698890535", "imageRef": "8d83db9f-9cf6-498a-b807-7f09f4d81b87", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-376892558", "networks": [{"uuid": "bd7cdf13-da54-4506-8d48-c8393a244995"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:34:55.706856 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] validate_networks() for [('bd7cdf13-da54-4506-8d48-c8393a244995', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:34:56.068994 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:34:56.069413 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:34:56.069889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:34:56.070293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:34:56.070699 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:34:56.079669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:56.080149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:56.080762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:56.081472 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:56.081918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:56.082351 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:56.099295 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Getting quotas for project 00950b4875f54197bf44bd1ffa353937. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:34:56.103512 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Getting quotas for user dd6241594ed040ce85c4b017cc361894 and project 00950b4875f54197bf44bd1ffa353937. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:34:56.114822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:34:56.117065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d83db9f-9cf6-498a-b807-7f09f4d81b87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:34:56.163305 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3b632f26-8d97-40d4-9bbb-df56e1dc4a1b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522967 Sep 12 23:34:56.164190 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 419/849] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:34:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:34:56.174851 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6409ed4d-6ede-4eda-9b8d-1124e710aefd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:56.175457 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6409ed4d-6ede-4eda-9b8d-1124e710aefd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:56.234473 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6409ed4d-6ede-4eda-9b8d-1124e710aefd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:56.243711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6409ed4d-6ede-4eda-9b8d-1124e710aefd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1257 microversion: 2.1 time: 0.072602 Sep 12 23:34:56.244783 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 431/850] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:56 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:56.542675 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:56.543250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:56.552106 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:56.553144 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:56.553744 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:56.555128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:56.555589 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:56.556372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:56.572979 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] HTTP exception thrown: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Request method failure captured: Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 HTTP/1.1 Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8CHhAHx0_QAUKRM8mT4BD5XqJvirD8qB2pAvBTk7n84lYObmDRceuuAnQcAzxv5N12PDfotan24lB7vQV_obX3asbiYVzqoAgMIKfXJ1J2eSDMJl-A28ufYuLzsDiTfuzNhvfsGQTCO59pi7baPR2i4XtF5FhPpBe0zQCa8YShwPV4 Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:34:56.574850 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aa1c574bdd14a1bb0ae5f82f892e6bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}] Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 2749a61b3dd04d89a5c2e4235aa96934 Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.576707 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'e07d4dcb-1679-4627-b94b-adc34cfffbb3'} Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:56.580688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.582524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.584204 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Returning 404 to user: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:56.584204 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8850be91-f17e-41cc-b0cf-d3706a47f218 tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 404 len: 111 microversion: 2.20 time: 0.038412 Sep 12 23:34:56.584204 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 420/851] 10.222.0.27 () {60 vars in 1280 bytes} [Mon Sep 12 23:34:56 2022] DELETE /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:34:56.587934 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:56.588583 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] [instance: e07d4dcb-1679-4627-b94b-adc34cfffbb3] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:56.596680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:56.597204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:56.597664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:56.598360 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:56.598809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:56.599234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:56.614387 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] HTTP exception thrown: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Request method failure captured: Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 HTTP/1.1 Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8CHhAHx0_QAUKRM8mT4BD5XqJvirD8qB2pAvBTk7n84lYObmDRceuuAnQcAzxv5N12PDfotan24lB7vQV_obX3asbiYVzqoAgMIKfXJ1J2eSDMJl-A28ufYuLzsDiTfuzNhvfsGQTCO59pi7baPR2i4XtF5FhPpBe0zQCa8YShwPV4 Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:34:56.616096 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5aa1c574bdd14a1bb0ae5f82f892e6bf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5aa1c574bdd14a1bb0ae5f82f892e6bf"}]}] Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 5aa1c574bdd14a1bb0ae5f82f892e6bf Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-780374671 Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 2749a61b3dd04d89a5c2e4235aa96934 Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeShelveTestJSON-780374671-project Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.617764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'e07d4dcb-1679-4627-b94b-adc34cfffbb3'} Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:34:56.620381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. Sep 12 23:34:56.622109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:34:56.623452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] Returning 404 to user: Instance e07d4dcb-1679-4627-b94b-adc34cfffbb3 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:34:56.623452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1bae3956-8300-4621-9d77-6ee0686e63cd tempest-AttachVolumeShelveTestJSON-780374671 tempest-AttachVolumeShelveTestJSON-780374671-project] 10.222.0.27 "GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3" status: 404 len: 111 microversion: 2.20 time: 0.035795 Sep 12 23:34:56.623452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 432/852] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Sep 12 23:34:56 2022] GET /compute/v2.1/servers/e07d4dcb-1679-4627-b94b-adc34cfffbb3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:34:57.266330 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:57.266951 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:57.273713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:57.274588 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:57.275020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:57.275780 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:57.276439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:57.277056 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:57.382018 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:57.390569 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9ae0346e-90e6-4b7f-952b-f2ce2f946463 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1309 microversion: 2.1 time: 0.128090 Sep 12 23:34:57.391721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 421/853] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:57 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:58.416404 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:58.417819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:58.428904 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:58.435875 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:58.438216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:58.441801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:58.442582 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:58.444198 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:58.696813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:34:58.710656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dd096f1f-9be8-414b-ba0e-b803322a6e4e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1315 microversion: 2.1 time: 0.298042 Sep 12 23:34:58.712077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 433/854] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:58 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:34:59.737011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:34:59.737776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:34:59.757783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:59.758385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:59.760157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:34:59.761299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:34:59.762455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:34:59.763917 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:00.072056 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:00.084822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0ecb2be0-e841-42da-b7e4-6f5dd3519ccf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.352827 Sep 12 23:35:00.085544 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 422/855] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:34:59 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:01.115409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:01.116506 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:01.137390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:01.139662 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:01.140514 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:01.142600 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:01.143200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:01.143664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:01.445730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:01.462403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-21aad036-f1b6-4f6a-b1c0-656a1d168835 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.355844 Sep 12 23:35:01.463462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 434/856] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:01 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:02.487401 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:02.488969 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:02.516436 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:02.517460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:02.524749 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:02.525900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:02.526460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:02.526908 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:02.836828 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:02.846354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-994599e8-807e-40dc-93c2-05f56591bb56 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.363495 Sep 12 23:35:02.847174 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 423/857] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:02 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:03.884147 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:03.886297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:03.900829 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:03.902435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:03.904929 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:03.906594 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:03.907068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:03.907499 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:04.142709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:04.155921 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cf80c5ab-6f45-4e3d-8aab-afeda1d08554 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.277650 Sep 12 23:35:04.164483 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 435/858] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:03 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:05.189344 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:05.190068 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:05.204104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:05.205066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:05.205749 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:05.207765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:05.208481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:05.209157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:05.546398 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:05.555620 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b4568c0b-9a3c-422e-9c6b-352c999afc55 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.371190 Sep 12 23:35:05.571693 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 424/859] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:05 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:06.585196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:06.585853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:06.598267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:06.601203 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:06.606204 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:06.607212 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:06.607953 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:06.608416 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:06.608840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:06.793397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:06.802062 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2a35da97-2ef0-4db2-88e1-352b30740dc0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.226114 Sep 12 23:35:06.803140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 436/860] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:06 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:07.827335 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:07.827973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:07.836665 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:07.837412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:07.844490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:07.845240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:07.845832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:07.846720 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:07.847392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:07.847990 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:07.972570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-ec6df572-756b-4262-8832-45ae7d224da5 req-128fb373-ee34-416f-8b5e-644f8a8cb771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "761f11ac-7169-4c25-9288-60b5bc3eed8a", "tag": "850a1b4c-80ad-42f1-b159-f1b2f080b1ea"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:07.985111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ec6df572-756b-4262-8832-45ae7d224da5 req-128fb373-ee34-416f-8b5e-644f8a8cb771 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:07.985968 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ec6df572-756b-4262-8832-45ae7d224da5 req-128fb373-ee34-416f-8b5e-644f8a8cb771 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:07.986625 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-ec6df572-756b-4262-8832-45ae7d224da5 req-128fb373-ee34-416f-8b5e-644f8a8cb771 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:08.000235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-ec6df572-756b-4262-8832-45ae7d224da5 req-128fb373-ee34-416f-8b5e-644f8a8cb771 service nova] Creating event network-changed:850a1b4c-80ad-42f1-b159-f1b2f080b1ea for instance 761f11ac-7169-4c25-9288-60b5bc3eed8a on hv-cinder-85200 Sep 12 23:35:08.015603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-ec6df572-756b-4262-8832-45ae7d224da5 req-128fb373-ee34-416f-8b5e-644f8a8cb771 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047567 Sep 12 23:35:08.016670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 437/861] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:35:08.209592 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:08.221524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ab7dbf3c-2cb3-4321-a58a-71330743b169 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.396803 Sep 12 23:35:08.237753 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 425/862] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:07 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:09.246996 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:09.248024 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:09.258837 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:09.259354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:09.259832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:09.260541 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:09.261918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:09.262428 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:09.761969 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ce3d3115-8a16-4695-8a54-5796a06d784e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: .version_select at 0x7fa4b361f040>, body: {"keypair": {"name": "tempest-keypair-1739365502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHRPFAKpZ03pJyDdY9gpZP1NhEYOxhvHMbLUrkeOkO91NY/Q7ZCbHfBgNA0/Zy/2TqV4+Jy/GtU9jtvVFjog9VkxDfo0JUQocMAzIy4xbpmuoE+MX1HR+Ug+mhq3QyBEQ=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:09.779203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ce3d3115-8a16-4695-8a54-5796a06d784e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:35:09.783357 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ce3d3115-8a16-4695-8a54-5796a06d784e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:35:09.804838 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:09.817154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ce3d3115-8a16-4695-8a54-5796a06d784e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184695 Sep 12 23:35:09.824402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 426/863] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:35:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:09.842129 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-66736f59-7b26-41be-86f7-e37cd60d8737 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.598303 Sep 12 23:35:09.849725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 438/864] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:09 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:10.869892 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:10.870546 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:10.880597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:10.881100 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:10.881536 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:10.882247 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:10.882700 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:10.883123 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:11.028460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:11.037813 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1544de45-9dd7-488c-aa15-369ee99bd8cf tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.172787 Sep 12 23:35:11.039604 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 427/865] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:10 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:11.324172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-127865645", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed4f9993-21de-4020-a46f-ad235aaa1a52"}], "security_groups": [{"name": "tempest-securitygroup--824181112"}], "key_name": "tempest-keypair-1739365502", "user_data": "}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:11.437809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] validate_networks() for [('ed4f9993-21de-4020-a46f-ad235aaa1a52', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:35:12.061136 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:12.062019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:12.069034 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:12.069771 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:12.070369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:12.071250 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:12.071873 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:12.072296 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:12.105654 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:35:12.106500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:35:12.107196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:35:12.107861 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:35:12.108719 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:35:12.121152 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:12.122127 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:12.122783 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:12.123803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:12.124471 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:12.125108 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:12.147285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:35:12.152544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:35:12.166804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:35:12.170581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:35:12.255980 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6047b160-ef9a-438e-a4b8-f9899ecd94ec tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.935652 Sep 12 23:35:12.259308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 439/866] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:35:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:35:12.282628 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6344ac3b-e14e-4ec0-8d62-f3b6b7b29091 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:12.295496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6344ac3b-e14e-4ec0-8d62-f3b6b7b29091 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:12.310462 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:12.322485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4ed51201-9bcb-4ed9-b411-87a2590df7b6 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.263768 Sep 12 23:35:12.343243 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 428/867] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:12 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:12.440318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6344ac3b-e14e-4ec0-8d62-f3b6b7b29091 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:12.470706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6344ac3b-e14e-4ec0-8d62-f3b6b7b29091 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1241 microversion: 2.1 time: 0.195919 Sep 12 23:35:12.471487 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 440/868] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:12 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1241 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:13.290975 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-561b82a7-700e-40c9-9d08-de407eee46f1 req-1f061d50-63b6-4f3f-bad6-7a4569c043f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "761f11ac-7169-4c25-9288-60b5bc3eed8a", "name": "network-vif-plugged", "status": "completed", "tag": "850a1b4c-80ad-42f1-b159-f1b2f080b1ea"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:13.310292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-561b82a7-700e-40c9-9d08-de407eee46f1 req-1f061d50-63b6-4f3f-bad6-7a4569c043f4 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:13.310955 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-561b82a7-700e-40c9-9d08-de407eee46f1 req-1f061d50-63b6-4f3f-bad6-7a4569c043f4 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:13.311394 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-561b82a7-700e-40c9-9d08-de407eee46f1 req-1f061d50-63b6-4f3f-bad6-7a4569c043f4 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:13.327356 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-561b82a7-700e-40c9-9d08-de407eee46f1 req-1f061d50-63b6-4f3f-bad6-7a4569c043f4 service nova] Creating event network-vif-plugged:850a1b4c-80ad-42f1-b159-f1b2f080b1ea for instance 761f11ac-7169-4c25-9288-60b5bc3eed8a on hv-cinder-85200 Sep 12 23:35:13.337183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-561b82a7-700e-40c9-9d08-de407eee46f1 req-1f061d50-63b6-4f3f-bad6-7a4569c043f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050008 Sep 12 23:35:13.338419 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 429/869] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:13.351442 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:13.352780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:13.363126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:13.364983 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:13.365619 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:13.366546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:13.367161 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:13.367818 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:13.494999 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:13.495811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:13.504134 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:13.504882 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:13.505545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:13.506482 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:13.507300 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:13.508790 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:13.540863 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:13.552336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1763c5db-908d-4b7c-9899-b83fe82cc23a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.205759 Sep 12 23:35:13.553468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 441/870] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:13 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:13.598506 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:13.607949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-69f2fe6d-c9d5-4574-9282-926e8bc2cb12 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1293 microversion: 2.1 time: 0.117588 Sep 12 23:35:13.619904 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 430/871] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:13 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:14.574694 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:14.575302 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:14.582591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:14.583393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:14.584185 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:14.584981 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:14.585557 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:14.586082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:14.635234 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:14.636544 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:14.645041 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:14.646158 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:14.647166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:14.648253 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:14.649268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:14.650013 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:14.856994 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:14.866770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c0daadd6-e16d-483c-9a3b-73f75d908bca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1366 microversion: 2.1 time: 0.237125 Sep 12 23:35:14.881738 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 431/872] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:14 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:14.915192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:14.924083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7e42e639-799b-4054-a194-dd5046d61ed1 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1357 microversion: 2.1 time: 0.352917 Sep 12 23:35:14.926515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 442/873] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:14 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1357 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:15.817796 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-d76b46aa-c857-4531-8308-06ed6fc47366 req-95aaecd5-afb1-4a7c-8314-17d71e51858d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49", "tag": "5a153622-8f69-4201-a53f-b4494737fcf9"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:15.828119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d76b46aa-c857-4531-8308-06ed6fc47366 req-95aaecd5-afb1-4a7c-8314-17d71e51858d service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:15.828594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d76b46aa-c857-4531-8308-06ed6fc47366 req-95aaecd5-afb1-4a7c-8314-17d71e51858d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:15.829201 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d76b46aa-c857-4531-8308-06ed6fc47366 req-95aaecd5-afb1-4a7c-8314-17d71e51858d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:15.841389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-d76b46aa-c857-4531-8308-06ed6fc47366 req-95aaecd5-afb1-4a7c-8314-17d71e51858d service nova] Creating event network-changed:5a153622-8f69-4201-a53f-b4494737fcf9 for instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 on hv-cinder-85200 Sep 12 23:35:15.846908 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-d76b46aa-c857-4531-8308-06ed6fc47366 req-95aaecd5-afb1-4a7c-8314-17d71e51858d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033217 Sep 12 23:35:15.848200 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 432/874] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:15.893210 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:15.894458 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:15.902941 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:15.903431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:15.904197 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:15.904919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:15.905634 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:15.906154 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:15.949910 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:15.951127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:15.959827 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:15.960307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:15.961098 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:15.961798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:15.962245 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:15.962662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:16.104301 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:16.113970 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-13911ded-299b-4c19-9616-8a7aa274e33d tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1546 microversion: 2.1 time: 0.169337 Sep 12 23:35:16.115141 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 433/875] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:15 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:16.136676 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:16.137282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:16.144034 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:16.144528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:16.144951 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:16.145645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:16.146262 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:16.146685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:16.163745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:16.175803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8ba3e161-ab66-4ac3-8baf-f30957a87461 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1366 microversion: 2.1 time: 0.286241 Sep 12 23:35:16.177362 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 443/876] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:15 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:16.287172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:16.296378 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6f8cb9ad-174a-484e-b7cf-598a97299b69 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1546 microversion: 2.1 time: 0.163727 Sep 12 23:35:16.297168 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 434/877] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:16 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:16.319126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:16.324681 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:16.325452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Searching by: {'deleted': False, 'project_id': '00950b4875f54197bf44bd1ffa353937'} {{(pid=120622) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 12 23:35:16.332781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:16.333267 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:16.333727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:16.334736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:16.335459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:16.335904 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:16.433376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.multi_cell_list [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120622) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 12 23:35:16.536471 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cbd3158c-b86a-416e-bbb7-d4c65c585271 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.220994 Sep 12 23:35:16.537099 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 444/878] 10.222.0.27 () {58 vars in 1125 bytes} [Mon Sep 12 23:35:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:16.548826 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:16.549442 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:16.555323 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:16.555848 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:16.556287 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:16.556985 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:16.557440 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:16.557866 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:16.686304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:16.689996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:16.695669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ce3a8914-21a1-4308-b37d-5169efe99869 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1546 microversion: 2.1 time: 0.150807 Sep 12 23:35:16.696239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 435/879] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:16 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:17.199793 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:17.200305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:17.207121 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:17.207671 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:17.208136 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:17.208912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:17.209383 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:17.209832 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:17.718515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:17.726692 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ba05e21d-aa1e-49b9-ba64-59efd98ec859 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1366 microversion: 2.1 time: 0.531089 Sep 12 23:35:17.727266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 445/880] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:17 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:18.254228 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e732a12-6f9e-44ce-b853-595bb5a9715a"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:18.256627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:18.263299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:18.263814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:18.264247 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:18.264926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:18.265373 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:18.265792 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:18.548023 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-00d61ee8-011c-4f44-9553-23dfa5f5b1c0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297561 Sep 12 23:35:18.548728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 436/881] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:35:18 2022] POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:18.749145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:18.749690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:18.756394 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:18.756870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:18.757301 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:18.757976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:18.758421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:18.758835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:18.777133 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:18.897308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:18.905729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c5249e5f-37e5-4cc9-838d-352aec36430c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1366 microversion: 2.1 time: 0.160454 Sep 12 23:35:18.906292 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 446/882] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:18 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:19.926406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:19.930938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:19.931662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:19.933504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:19.939717 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:19.940200 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:19.940636 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:19.941313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:19.941761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:19.942183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:20.078289 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:20.086393 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-28b6d13b-a3d2-40bb-8661-6fc30ffdd933 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1366 microversion: 2.1 time: 0.161359 Sep 12 23:35:20.087170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 437/883] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:19 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:21.111551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:21.113423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:21.116701 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:21.124719 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:21.125497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:21.126214 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:21.127156 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:21.128094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:21.128751 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:21.273802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:21.282398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0d9fa06e-1562-454b-8378-e9e9a808146f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1366 microversion: 2.1 time: 0.175606 Sep 12 23:35:21.282857 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 447/884] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:21 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:21.292586 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-71e274b2-fb34-45b1-b35e-e1daf6eebeed req-3fe17069-8e56-4251-a887-e772481c105f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49", "name": "network-vif-plugged", "status": "completed", "tag": "5a153622-8f69-4201-a53f-b4494737fcf9"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:21.303286 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-71e274b2-fb34-45b1-b35e-e1daf6eebeed req-3fe17069-8e56-4251-a887-e772481c105f service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:21.303923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-71e274b2-fb34-45b1-b35e-e1daf6eebeed req-3fe17069-8e56-4251-a887-e772481c105f service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:21.304534 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-71e274b2-fb34-45b1-b35e-e1daf6eebeed req-3fe17069-8e56-4251-a887-e772481c105f service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:21.316003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-71e274b2-fb34-45b1-b35e-e1daf6eebeed req-3fe17069-8e56-4251-a887-e772481c105f service nova] Creating event network-vif-plugged:5a153622-8f69-4201-a53f-b4494737fcf9 for instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 on hv-cinder-85200 Sep 12 23:35:21.320906 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-71e274b2-fb34-45b1-b35e-e1daf6eebeed req-3fe17069-8e56-4251-a887-e772481c105f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032276 Sep 12 23:35:21.321500 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 438/885] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:22.307669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:22.308284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:22.314637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:22.315893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:22.316226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:22.316952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:22.317414 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:22.317842 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:22.455858 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:22.463406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7b3ddecf-c955-4e4e-9879-7a2eda01d869 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1366 microversion: 2.1 time: 0.159730 Sep 12 23:35:22.464013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 448/886] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:22 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:23.487921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:23.488816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:23.495084 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:23.495587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:23.496031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:23.496755 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:23.497209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:23.497639 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:23.633402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:23.641088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d64c39f4-ebb2-4b32-9004-cbfa8e1a2626 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1555 microversion: 2.1 time: 0.158444 Sep 12 23:35:23.641649 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 439/887] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:23 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:23.664395 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:23.665050 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:23.666919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=8 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:23.673314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:23.673836 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:23.674914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:23.675672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:23.676135 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:23.676559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:23.766055 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-826b074f-201f-4614-aadf-0006ab2dc14c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105969 Sep 12 23:35:23.766720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 449/888] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:35:23 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:24.847441 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-5ede5508-a43d-4db5-9282-c7aef1f55006 req-684b0d5a-760a-49e1-8b11-50b4d066567a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49", "tag": "5a153622-8f69-4201-a53f-b4494737fcf9"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:24.869486 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5ede5508-a43d-4db5-9282-c7aef1f55006 req-684b0d5a-760a-49e1-8b11-50b4d066567a service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:24.869972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5ede5508-a43d-4db5-9282-c7aef1f55006 req-684b0d5a-760a-49e1-8b11-50b4d066567a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:24.870402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5ede5508-a43d-4db5-9282-c7aef1f55006 req-684b0d5a-760a-49e1-8b11-50b4d066567a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:24.884140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-5ede5508-a43d-4db5-9282-c7aef1f55006 req-684b0d5a-760a-49e1-8b11-50b4d066567a service nova] Creating event network-changed:5a153622-8f69-4201-a53f-b4494737fcf9 for instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 on hv-cinder-85200 Sep 12 23:35:24.890805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-5ede5508-a43d-4db5-9282-c7aef1f55006 req-684b0d5a-760a-49e1-8b11-50b4d066567a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047073 Sep 12 23:35:24.891420 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 440/889] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:25.178151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:25.178736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:25.187073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:25.188013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:25.189468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:25.190451 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:25.191059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:25.191803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:25.518054 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:25.527355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ede3084f-047c-40da-abef-18158f331839 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1592 microversion: 2.1 time: 0.353465 Sep 12 23:35:25.528680 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 450/890] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:25 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1592 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:27.848628 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-690e52b4-c799-44e0-a703-3c1fb2f23d60 req-faab4038-e01a-4565-95da-9f58462576b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "761f11ac-7169-4c25-9288-60b5bc3eed8a", "tag": "850a1b4c-80ad-42f1-b159-f1b2f080b1ea"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:27.858643 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-690e52b4-c799-44e0-a703-3c1fb2f23d60 req-faab4038-e01a-4565-95da-9f58462576b6 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:27.859128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-690e52b4-c799-44e0-a703-3c1fb2f23d60 req-faab4038-e01a-4565-95da-9f58462576b6 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:27.859582 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-690e52b4-c799-44e0-a703-3c1fb2f23d60 req-faab4038-e01a-4565-95da-9f58462576b6 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:27.871498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-690e52b4-c799-44e0-a703-3c1fb2f23d60 req-faab4038-e01a-4565-95da-9f58462576b6 service nova] Creating event network-changed:850a1b4c-80ad-42f1-b159-f1b2f080b1ea for instance 761f11ac-7169-4c25-9288-60b5bc3eed8a on hv-cinder-85200 Sep 12 23:35:27.877924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-690e52b4-c799-44e0-a703-3c1fb2f23d60 req-faab4038-e01a-4565-95da-9f58462576b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033735 Sep 12 23:35:27.878597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 441/891] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:28.178940 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1446418953", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "networks": [{"uuid": "3c81539a-e58b-4e42-89a7-b99d91ff7988"}]}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:28.188525 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=4 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:28.240001 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] validate_networks() for [('3c81539a-e58b-4e42-89a7-b99d91ff7988', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:35:28.871786 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:35:28.872304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:35:28.872847 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:35:28.873331 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:35:28.873792 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:35:28.882811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:28.883363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:28.883919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:28.884684 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:28.885142 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:28.885569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:28.905379 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Getting quotas for project 24ded699e3a3432cbe1656777da8f958. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:35:28.910675 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Getting quotas for user b72692bbe1e9455db47a1b7e5995c01c and project 24ded699e3a3432cbe1656777da8f958. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:35:28.922626 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:35:28.925015 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:35:28.995545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e9bd071f-7d9c-4595-8ecb-67f7ebea7ce1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821718 Sep 12 23:35:28.996350 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 451/892] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:35:29.009645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-677ee95e-dd17-468d-871a-dce23dd2f6f1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:29.010562 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-677ee95e-dd17-468d-871a-dce23dd2f6f1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:29.110604 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-677ee95e-dd17-468d-871a-dce23dd2f6f1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:29.124406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-677ee95e-dd17-468d-871a-dce23dd2f6f1 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1219 microversion: 2.1 time: 0.120638 Sep 12 23:35:29.125001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 442/893] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:29 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:29.158291 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1336849925"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:29.158872 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:29.168427 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:29.168924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:29.169373 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:29.170065 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:29.170513 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:29.171161 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:29.338341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.network.security_group_api [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Adding security group 63a59ec2-8575-46a6-b974-b6a29ba9ece8 to port 850a1b4c-80ad-42f1-b159-f1b2f080b1ea Sep 12 23:35:29.681200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-61404789-d8f8-48c7-871d-4c4075ec4a31 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/action" status: 202 len: 0 microversion: 2.1 time: 0.527406 Sep 12 23:35:29.681951 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 452/894] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:35:29 2022] POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:35:29.690624 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:29.691235 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:29.695613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-f1e0e6e7-60bd-4982-b7e8-cda7d3bce943 req-c3db4d2f-6a2d-4de4-8346-388e2db4a5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "761f11ac-7169-4c25-9288-60b5bc3eed8a", "tag": "850a1b4c-80ad-42f1-b159-f1b2f080b1ea"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:29.708481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:29.709431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:29.710667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:29.711783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:29.712451 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:29.713167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:29.714521 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-f1e0e6e7-60bd-4982-b7e8-cda7d3bce943 req-c3db4d2f-6a2d-4de4-8346-388e2db4a5ec service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:29.715369 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-f1e0e6e7-60bd-4982-b7e8-cda7d3bce943 req-c3db4d2f-6a2d-4de4-8346-388e2db4a5ec service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:29.717745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-f1e0e6e7-60bd-4982-b7e8-cda7d3bce943 req-c3db4d2f-6a2d-4de4-8346-388e2db4a5ec service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:29.749905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-f1e0e6e7-60bd-4982-b7e8-cda7d3bce943 req-c3db4d2f-6a2d-4de4-8346-388e2db4a5ec service nova] Creating event network-changed:850a1b4c-80ad-42f1-b159-f1b2f080b1ea for instance 761f11ac-7169-4c25-9288-60b5bc3eed8a on hv-cinder-85200 Sep 12 23:35:29.761917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-f1e0e6e7-60bd-4982-b7e8-cda7d3bce943 req-c3db4d2f-6a2d-4de4-8346-388e2db4a5ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070982 Sep 12 23:35:29.763609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 453/895] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:35:29.943687 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:29.951894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4b39be83-d1b9-48cd-a7ff-09bbed5fc8ed tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1758 microversion: 2.1 time: 0.265344 Sep 12 23:35:29.952552 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 443/896] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:29 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1758 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:30.150272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:30.150967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:30.157040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:30.157523 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:30.157964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:30.159145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:30.159631 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:30.160056 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:30.237432 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:30.248143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ba642ce9-839d-465c-b0a5-3deecf82d21d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1271 microversion: 2.1 time: 0.101828 Sep 12 23:35:30.248739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 454/897] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:30 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:31.274853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:31.275464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:31.282389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:31.282880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:31.283309 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:31.284031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:31.284649 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:31.285076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:31.479843 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:31.488475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e8beb99f-6136-4265-8725-05fbd5835171 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.217932 Sep 12 23:35:31.489066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 444/898] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:31 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:31.718825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-41297e69-97e3-455b-aefe-281b76596a61 req-c810ef8a-5fbb-40d9-8d96-0bdf15778bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97fd6b9-4088-45a5-94a2-3a284e0dd3c5", "tag": "c8c4cd5d-2829-4eda-9d53-9a41f69d724d"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:31.729546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-41297e69-97e3-455b-aefe-281b76596a61 req-c810ef8a-5fbb-40d9-8d96-0bdf15778bf5 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:31.730114 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-41297e69-97e3-455b-aefe-281b76596a61 req-c810ef8a-5fbb-40d9-8d96-0bdf15778bf5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:31.730535 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-41297e69-97e3-455b-aefe-281b76596a61 req-c810ef8a-5fbb-40d9-8d96-0bdf15778bf5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:31.743751 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-41297e69-97e3-455b-aefe-281b76596a61 req-c810ef8a-5fbb-40d9-8d96-0bdf15778bf5 service nova] Creating event network-changed:c8c4cd5d-2829-4eda-9d53-9a41f69d724d for instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 on hv-cinder-85200 Sep 12 23:35:31.748529 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-41297e69-97e3-455b-aefe-281b76596a61 req-c810ef8a-5fbb-40d9-8d96-0bdf15778bf5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033615 Sep 12 23:35:31.749677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 455/899] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:35:32.511526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:32.512157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:32.518524 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:32.519001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:32.519432 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:32.520149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:32.520601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:32.521050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:32.652220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:32.659872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-43976c00-b3d9-4ef9-95ef-947f51f31ae6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.152263 Sep 12 23:35:32.660439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 445/900] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:32 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:33.682804 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:33.683500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:33.690556 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:33.691029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:33.691453 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:33.692158 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:33.692605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:33.693018 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:33.821949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:33.829655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7e445aba-0da2-4d1b-a050-9ba4f020d0da tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.151140 Sep 12 23:35:33.830769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 456/901] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:33 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:34.852792 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:34.853308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:34.859799 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:34.860277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:34.860709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:34.861389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:34.861838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:34.862255 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:34.993372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:35.000869 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6f74154a-469c-4f50-8975-6969095c2555 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.151982 Sep 12 23:35:35.001425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 446/902] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:34 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:36.023943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:36.024575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:36.031107 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:36.031613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:36.032046 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:36.032757 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:36.033731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:36.034150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:36.171478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:36.179796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1f4dcae0-f88e-4ac6-bbff-0c46bb84448e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.160120 Sep 12 23:35:36.180294 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 457/903] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:36 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:37.202458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:37.203073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:37.209500 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:37.210205 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:37.210654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:37.211332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:37.211813 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:37.212235 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:37.294068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-de51722b-0440-4b57-b95f-0f6f1c714b7e req-f99e6cab-a570-40d8-81db-a243efd55679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97fd6b9-4088-45a5-94a2-3a284e0dd3c5", "name": "network-vif-plugged", "status": "completed", "tag": "c8c4cd5d-2829-4eda-9d53-9a41f69d724d"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:37.305283 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-de51722b-0440-4b57-b95f-0f6f1c714b7e req-f99e6cab-a570-40d8-81db-a243efd55679 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:37.306077 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-de51722b-0440-4b57-b95f-0f6f1c714b7e req-f99e6cab-a570-40d8-81db-a243efd55679 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:37.306714 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-de51722b-0440-4b57-b95f-0f6f1c714b7e req-f99e6cab-a570-40d8-81db-a243efd55679 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:37.319967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-de51722b-0440-4b57-b95f-0f6f1c714b7e req-f99e6cab-a570-40d8-81db-a243efd55679 service nova] Creating event network-vif-plugged:c8c4cd5d-2829-4eda-9d53-9a41f69d724d for instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 on hv-cinder-85200 Sep 12 23:35:37.325769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-de51722b-0440-4b57-b95f-0f6f1c714b7e req-f99e6cab-a570-40d8-81db-a243efd55679 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035777 Sep 12 23:35:37.326370 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 458/904] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:37.353527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:37.362305 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ac77558d-222b-437b-b531-5e9f3a03b2d2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.163857 Sep 12 23:35:37.362925 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 447/905] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:37 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:38.386972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:38.387700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:38.393758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:38.394232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:38.394664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:38.395337 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:38.395808 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:38.396225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:38.529825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:38.541275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9aeb3884-9e71-4926-8929-d0a460e2fbb7 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1319 microversion: 2.1 time: 0.158787 Sep 12 23:35:38.541861 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 459/906] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:38 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:39.566924 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:39.567461 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:39.569986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:39.575427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:39.575952 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:39.576389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:39.577088 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:39.577558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:39.577976 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:39.703061 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:39.710889 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c54594d6-210c-45aa-bcea-c9fe8423a05d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1508 microversion: 2.1 time: 0.148542 Sep 12 23:35:39.711445 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 448/907] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:39 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:52.684685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:52.687548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:52.689955 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:52.690631 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:52.693089 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:52.693721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=60 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:52.701469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:52.701703 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:52.702118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:52.702768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:52.703213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:52.703663 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:52.780824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b726eda0-50f0-4cff-b072-2e1d7c130c94 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/action" status: 202 len: 0 microversion: 2.1 time: 0.100326 Sep 12 23:35:52.781564 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 460/908] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:35:52 2022] POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:35:52.789507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:52.790113 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:52.792547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=25 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:52.793421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:35:52.799076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:52.799560 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:52.800020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:52.800765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:52.801184 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:52.801697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:53.027439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:53.036110 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0e86dace-52e8-40c5-9c55-93e8f9c74076 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1750 microversion: 2.1 time: 0.250358 Sep 12 23:35:53.036689 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 449/909] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:52 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1750 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:54.060771 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:54.061565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:54.068146 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:54.068629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:54.069067 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:54.069754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:54.070210 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:54.070632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:54.215087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:54.224048 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6990adfa-bc67-4f23-b1fd-3035a7dbcb8c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.168033 Sep 12 23:35:54.224633 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 461/910] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:54 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:54.828963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1431510003", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1903603689", "security_groups": [{"name": "tempest-secgroup-smoke-575282427"}], "block_device_mapping_v2": [{"uuid": "d652643f-1908-449c-be6d-a0831832923b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eca586cf-58eb-48f2-bcf7-9aa793fb9bf1"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:55.006396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] validate_networks() for [('eca586cf-58eb-48f2-bcf7-9aa793fb9bf1', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:35:55.253845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:55.255115 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:55.262380 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.263058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.263790 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.264633 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.265390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.266159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.424160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:55.433074 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b4c6e494-7eb1-49c7-9526-b578b51919b8 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.183329 Sep 12 23:35:55.433645 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 462/911] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:55 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:55.573627 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:55.574584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:55.580840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.581615 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.582121 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.582890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.583621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.584159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.610460 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:35:55.618833 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:35:55.619627 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:35:55.620487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:35:55.620899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:35:55.621314 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:35:55.632264 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.632747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.633183 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.633972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.634396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.634880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.655112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for project eaa5d21fc40540e4b811713e5efeff46. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:35:55.659320 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Getting quotas for user 2d62232282dc4455834857d5290eb169 and project eaa5d21fc40540e4b811713e5efeff46. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:35:55.693396 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-67f731ae-97c7-45e6-aee2-b530d6e4d6ae tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 204 len: 0 microversion: 2.1 time: 0.123124 Sep 12 23:35:55.694396 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 463/912] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:35:55 2022] DELETE /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 23:35:55.700268 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-6e087c29-7995-4a3d-889c-5be472595c46 req-ca87bd4f-97ed-4d23-b45e-85acdc5eb006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0ad905-fb81-48ab-9712-10d8badbd7f6", "tag": "6ccc2d74-2c48-49e0-b714-f319925458f8"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:55.710501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-6e087c29-7995-4a3d-889c-5be472595c46 req-ca87bd4f-97ed-4d23-b45e-85acdc5eb006 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.711036 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-6e087c29-7995-4a3d-889c-5be472595c46 req-ca87bd4f-97ed-4d23-b45e-85acdc5eb006 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.711531 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-6e087c29-7995-4a3d-889c-5be472595c46 req-ca87bd4f-97ed-4d23-b45e-85acdc5eb006 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.723643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-6e087c29-7995-4a3d-889c-5be472595c46 req-ca87bd4f-97ed-4d23-b45e-85acdc5eb006 service nova] Creating event network-changed:6ccc2d74-2c48-49e0-b714-f319925458f8 for instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 on hv-cinder-85200 Sep 12 23:35:55.728601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-6e087c29-7995-4a3d-889c-5be472595c46 req-ca87bd4f-97ed-4d23-b45e-85acdc5eb006 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 Sep 12 23:35:55.729469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 464/913] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:55.735492 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:55.736313 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:55.742700 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:35:55.742843 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.743206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.743675 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.744391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:55.744836 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:55.744963 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d652643f-1908-449c-be6d-a0831832923b',volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:35:55.745266 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:55.894386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:55.895777 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ece8db65-a3eb-435b-9bcf-5bfc27ca0825 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.070322 Sep 12 23:35:55.897402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 450/914] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:35:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:35:55.912513 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d280da4f-58ab-407b-a18e-78d3f9a88408 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:55.913891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d280da4f-58ab-407b-a18e-78d3f9a88408 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:55.914575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7d0c6340-544b-49df-bc28-82fd922366dc tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.183759 Sep 12 23:35:55.915164 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 465/915] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:55 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:55.990728 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d280da4f-58ab-407b-a18e-78d3f9a88408 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:56.002561 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d280da4f-58ab-407b-a18e-78d3f9a88408 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1095 microversion: 2.1 time: 0.094812 Sep 12 23:35:56.012224 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 451/916] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:55 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:56.456922 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:56.458107 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:56.464515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:56.464999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:56.465431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:56.466118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:56.466569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:56.466988 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:56.609858 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:56.617903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-16bbde53-7e39-4f0c-98a6-79fe0fd30a6c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.164834 Sep 12 23:35:56.618464 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 466/917] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:56 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:56.939917 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:56.940555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:56.947880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:56.948355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:56.948785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:56.949464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:56.949909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:56.950391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:57.026767 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:57.027406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:57.036391 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:57.037169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:57.037775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:57.038674 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:57.039308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:57.039919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:57.134725 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:57.137274 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:57.142717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2dbb9479-7de6-4ec4-891e-db4e3f7666df tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1145 microversion: 2.1 time: 0.120132 Sep 12 23:35:57.143476 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 467/918] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:57 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1145 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:57.145784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-25e2f5ea-b2bf-48c4-a159-7c8c1bb8921a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1569 microversion: 2.1 time: 0.209069 Sep 12 23:35:57.146578 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 452/919] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:56 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:57.149802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1802443-302c-4091-9a9f-9b79cfb74b14", "device": "/dev/sdb"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:57.152971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:57.159812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:57.160905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:57.161340 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:57.162028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:57.162475 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:57.162894 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:57.642667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:57.643754 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:57.653220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:57.653762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:57.654243 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:57.654880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:57.655328 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:57.656114 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:57.688446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d38201c9-b9da-45ce-8c21-8ace03a90fe6 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "POST /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543153 Sep 12 23:35:57.692098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 468/920] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:35:57 2022] POST /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:57.941298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:57.950570 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e527058a-a109-458a-9791-58127f246d76 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.311939 Sep 12 23:35:57.951167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 453/921] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:57 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:58.170495 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:58.175652 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:58.177271 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:58.180701 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:58.188769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:58.189263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:58.189697 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:58.190400 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:58.190852 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:58.191273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:58.199908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:58.200555 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:58.200996 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:58.201700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:58.202162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:58.202592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:58.321386 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:58.335981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1236627b-f2b8-4f1d-b531-15023418646a tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1383 microversion: 2.1 time: 0.167981 Sep 12 23:35:58.350007 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 454/922] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:58 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1383 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:58.352298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:58.362278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c57c295a-ee8d-49e3-a18f-d26b28bb7976 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1201 microversion: 2.1 time: 0.197546 Sep 12 23:35:58.364627 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 469/923] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:58 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1201 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:58.413492 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-58809a73-51a6-4014-947c-97bbdf83580c req-054c9e29-6120-4b2d-b07f-5effd72ad1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0ad905-fb81-48ab-9712-10d8badbd7f6", "name": "network-vif-deleted", "tag": "6ccc2d74-2c48-49e0-b714-f319925458f8"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:58.423444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-58809a73-51a6-4014-947c-97bbdf83580c req-054c9e29-6120-4b2d-b07f-5effd72ad1bf service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:58.423931 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-58809a73-51a6-4014-947c-97bbdf83580c req-054c9e29-6120-4b2d-b07f-5effd72ad1bf service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:58.424559 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-58809a73-51a6-4014-947c-97bbdf83580c req-054c9e29-6120-4b2d-b07f-5effd72ad1bf service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:58.443147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-58809a73-51a6-4014-947c-97bbdf83580c req-054c9e29-6120-4b2d-b07f-5effd72ad1bf service nova] Creating event network-vif-deleted:6ccc2d74-2c48-49e0-b714-f319925458f8 for instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 on hv-cinder-85200 Sep 12 23:35:58.451231 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-58809a73-51a6-4014-947c-97bbdf83580c req-054c9e29-6120-4b2d-b07f-5effd72ad1bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 Sep 12 23:35:58.456117 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 455/924] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:35:58.977411 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:58.978275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:58.988175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:58.989849 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:58.990394 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:58.991222 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:58.991932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:58.992438 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:59.189425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:59.199159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-36745c4e-be13-47be-bc47-1bfb61f554f0 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.226099 Sep 12 23:35:59.201613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 470/925] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:58 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:59.362883 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:59.364238 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:59.370996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:59.373355 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:59.373685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:59.374558 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:59.375137 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:59.375581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:59.389777 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:35:59.390386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:35:59.397067 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:59.397869 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:59.398296 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:59.399177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:59.399715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:59.400140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:59.411997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:59.412564 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:59.413216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:59.413855 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lazy-loading 'fault' on Instance uuid 6c0ad905-fb81-48ab-9712-10d8badbd7f6 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:35:59.476092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e22d2226f77454fb3f155dbf3fdf471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ac3aed7b1e495f81dc29d224be1eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:59.484020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-55095ecb-4bf8-40bf-8568-30270fc5a79b tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 200 len: 1224 microversion: 2.1 time: 0.125974 Sep 12 23:35:59.484594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 456/926] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:59 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:35:59.554246 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:35:59.566602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a4c09865-69d9-4bad-931f-754194a6a099 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1278 microversion: 2.1 time: 0.180969 Sep 12 23:35:59.568176 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 471/927] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:35:59 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:35:59.831616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-2e117407-61a9-4d11-b894-59dc5faea9d5 req-3b6ef145-ca65-4e79-88fe-258bdf3d598d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb291d6-b18d-4241-b659-50cf940eb227", "tag": "9161919b-1838-4c64-a5a8-de22e08e110b"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:35:59.842004 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2e117407-61a9-4d11-b894-59dc5faea9d5 req-3b6ef145-ca65-4e79-88fe-258bdf3d598d service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:35:59.842821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2e117407-61a9-4d11-b894-59dc5faea9d5 req-3b6ef145-ca65-4e79-88fe-258bdf3d598d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:35:59.843432 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2e117407-61a9-4d11-b894-59dc5faea9d5 req-3b6ef145-ca65-4e79-88fe-258bdf3d598d service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:35:59.856020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-2e117407-61a9-4d11-b894-59dc5faea9d5 req-3b6ef145-ca65-4e79-88fe-258bdf3d598d service nova] Creating event network-changed:9161919b-1838-4c64-a5a8-de22e08e110b for instance afb291d6-b18d-4241-b659-50cf940eb227 on hv-cinder-85200 Sep 12 23:35:59.860861 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-2e117407-61a9-4d11-b894-59dc5faea9d5 req-3b6ef145-ca65-4e79-88fe-258bdf3d598d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033000 Sep 12 23:35:59.861501 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 457/928] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:36:00.224769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:00.225413 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:00.231455 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:00.232181 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:00.232916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:00.232916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:00.233753 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:00.233949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:00.379868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:00.388440 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a9445f7a-4352-4750-856a-e979615b796b tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.167628 Sep 12 23:36:00.389031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 472/929] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:00 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:36:00.513010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:00.513708 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] [instance: 6c0ad905-fb81-48ab-9712-10d8badbd7f6] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:00.520591 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:00.521078 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:00.521510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:00.522283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:00.522988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:00.523412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:00.536705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] HTTP exception thrown: Instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 could not be found. Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Request method failure captured: Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 HTTP/1.1 Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8FCHe3jifmG5GcJpk4h4aHCyc51aRTI0bjhZ7I1BltC5uGmhGf8dgomlfbZIM13EBT4g5D-3MzfXXdhKPENE8YA17l_VFwqigJBRywm_LXGtwNTtQ3s5Xl7RG8jxilRBWBceLAEgVfspE9zIbDrHAueoc8ab5APW1aqgKyiu-J7Pqo Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: e3ac3aed7b1e495f81dc29d224be1eba Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestShelveInstance-1453885844 Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:36:00.538346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3ac3aed7b1e495f81dc29d224be1eba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3ac3aed7b1e495f81dc29d224be1eba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3ac3aed7b1e495f81dc29d224be1eba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3ac3aed7b1e495f81dc29d224be1eba"}]}] Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestShelveInstance-1453885844 Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: e3ac3aed7b1e495f81dc29d224be1eba Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestShelveInstance-1453885844 Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-TestShelveInstance-1453885844-project Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 2e22d2226f77454fb3f155dbf3fdf471 Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestShelveInstance-1453885844-project Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 could not be found. Sep 12 23:36:00.540380 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '6c0ad905-fb81-48ab-9712-10d8badbd7f6'} Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 could not be found. Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:36:00.541239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 could not be found. Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 could not be found. Sep 12 23:36:00.542645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:00.543945 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Returning 404 to user: Instance 6c0ad905-fb81-48ab-9712-10d8badbd7f6 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:36:00.543945 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d1d48ead-e7d1-402f-8514-788b85459da0 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6" status: 404 len: 111 microversion: 2.1 time: 0.031448 Sep 12 23:36:00.543945 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 458/930] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:00 2022] GET /compute/v2.1/servers/6c0ad905-fb81-48ab-9712-10d8badbd7f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:36:00.590721 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:00.591514 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:00.598683 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:00.599398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:00.599872 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:00.600699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:00.601153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:00.601569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:00.605882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:00.795592 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ca8ffe08-e044-4854-a86f-182e217c10a1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] Calling method '.version_select at 0x7fa4b361fb80>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:00.810850 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:00.824995 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-96610c46-bf0b-4f5d-9776-de8edc9c10bf tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1278 microversion: 2.1 time: 0.238499 Sep 12 23:36:00.826808 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 473/931] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:00 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:00.841259 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ca8ffe08-e044-4854-a86f-182e217c10a1 tempest-TestShelveInstance-1453885844 tempest-TestShelveInstance-1453885844-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1045113572" status: 202 len: 0 microversion: 2.1 time: 0.049545 Sep 12 23:36:00.841844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 459/932] 10.222.0.27 () {58 vars in 1254 bytes} [Mon Sep 12 23:36:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1045113572 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:36:01.416477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:01.417192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:01.423745 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:01.424185 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:01.424605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:01.425308 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:01.425753 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:01.426169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:01.583153 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:01.591910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9a5dfd56-9071-4235-8c4f-0d53c43d97ae tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.179523 Sep 12 23:36:01.592562 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 474/933] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:01 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:01.850713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:01.851448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:01.858114 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:01.858593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:01.859028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:01.859751 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:01.860209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:01.860637 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:02.071184 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:02.079223 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a70093e4-c9b7-4ddc-8c3a-9dd91bd660e0 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1278 microversion: 2.1 time: 0.232875 Sep 12 23:36:02.079838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 460/934] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:01 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:02.616354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:02.616968 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:02.623346 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:02.623862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:02.624452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:02.625140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:02.625591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:02.626011 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:02.870615 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:02.882107 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0338beb8-20c2-45ba-8644-be28e3b89b49 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.270468 Sep 12 23:36:02.884137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 475/935] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:02 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:03.103282 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:03.105464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:03.124395 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:03.125089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:03.126193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:03.137801 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:03.138387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:03.138894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:03.293874 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:03.302160 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aa55de79-feb3-40a2-a1bc-82d5c9db05da tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1278 microversion: 2.1 time: 0.203145 Sep 12 23:36:03.302733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 461/936] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:03 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:03.907084 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:03.908265 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:03.915449 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:03.915990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:03.916425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:03.917124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:03.917578 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:03.918030 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:04.185557 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:04.197544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-441bea88-38f5-42ed-89a0-2df785633faa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.294475 Sep 12 23:36:04.213381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 476/937] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:03 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:04.325587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:04.326926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:04.334300 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:04.335654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:04.336239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:04.336851 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:04.337308 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:04.337733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:04.580645 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:04.588538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ff38405f-6d06-43ca-9730-46836291b30e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1278 microversion: 2.1 time: 0.266702 Sep 12 23:36:04.589122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 462/938] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:04 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:05.224298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:05.224840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:05.231038 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:05.231527 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:05.232480 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:05.233176 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:05.233630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:05.234059 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:05.421081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:05.431019 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2699e0c4-f6c9-4d19-aa58-7231b3c90862 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.211281 Sep 12 23:36:05.431897 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 477/939] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:05 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:05.611551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:05.613483 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:05.620823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:05.621400 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:05.621894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:05.622605 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:05.623067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:05.623506 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:05.645526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:05.830634 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:05.838829 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-82109d72-0e27-4b44-a1ba-8f716be40795 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.232425 Sep 12 23:36:05.839491 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 463/940] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:05 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:36:06.454238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:06.454775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:06.463418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:06.464187 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:06.464615 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:06.465491 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:06.465860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:06.466610 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:06.626775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:06.636137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-246efabf-8692-48be-b30e-fcf4e43e0c17 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.185715 Sep 12 23:36:06.654048 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 478/941] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:06 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:06.862928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:06.863808 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:06.869059 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:06.871842 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:06.872575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:06.873109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:06.874078 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:06.874632 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:06.875157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:07.023090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:07.031388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-006afdd0-ec2b-4c19-b2c1-b1eb32198e37 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.172363 Sep 12 23:36:07.035613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 464/942] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:06 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:07.662856 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:07.663635 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:07.670609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:07.671311 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:07.671853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:07.672567 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:07.673006 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:07.673570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:07.884011 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:07.892206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f1c65e7d-0d27-4af9-a054-261b03482952 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.234528 Sep 12 23:36:07.892781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 479/943] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:07 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:08.058182 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:08.058782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:08.065248 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:08.065741 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:08.066814 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:08.067515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:08.067972 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:08.068391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:08.200772 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:08.208757 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-adf82d3d-159d-440f-9a69-68f2bbbe8c48 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.154390 Sep 12 23:36:08.209319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 465/944] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:08 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:08.916733 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:08.917918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:08.925517 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:08.926081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:08.926579 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:08.927469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:08.928015 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:08.928498 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:09.085235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:09.095759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9ef8f28b-eff9-4355-9e37-2fed050cbff7 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1755 microversion: 2.1 time: 0.182945 Sep 12 23:36:09.096762 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 480/945] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:08 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:09.231163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:09.231819 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:09.238594 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:09.239070 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:09.239501 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:09.240203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:09.240654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:09.241073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:09.369896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:09.377761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fc18ea93-bdf4-4c5d-9f3d-0b73dbd3d786 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.150410 Sep 12 23:36:09.378327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 466/946] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:09 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:10.120044 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:10.120590 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:10.126933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:10.127410 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:10.127860 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:10.128544 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:10.128988 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:10.129405 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:10.266378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:10.275282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-e377e4ae-6c8b-4d9f-aff5-ddc0052df1dd tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1758 microversion: 2.1 time: 0.159228 Sep 12 23:36:10.275884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 481/947] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:10 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:10.402053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:10.402571 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:10.409010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:10.409538 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:10.409966 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:10.410640 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:10.411086 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:10.411502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:10.538663 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:10.546275 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2d91f8b9-2b8c-4028-a63c-d469ad6182ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.148067 Sep 12 23:36:10.546836 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 467/948] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:10 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:11.502338 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:11.502890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:11.509272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:11.509750 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:11.510179 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:11.510861 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:11.511311 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:11.511769 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:11.535263 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7dfdcd45-66c1-40d8-a9cf-91dfa27579eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/ips" status: 200 len: 148 microversion: 2.1 time: 0.036164 Sep 12 23:36:11.535829 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 482/949] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:36:11 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:11.568691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:11.569373 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:11.575872 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:11.576444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:11.576965 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:11.577547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:11.577992 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:11.578408 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:11.714387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:11.721949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-99a1d1de-cd20-417e-b75e-285cccd71e6c tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.156993 Sep 12 23:36:11.723028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 468/950] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:11 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:12.745022 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:12.745577 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:12.752051 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:12.752540 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:12.752971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:12.754167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:12.754618 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:12.755039 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:12.889752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:12.898407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-865d2960-788c-4ba3-91e0-2dea8ce03e69 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.157344 Sep 12 23:36:12.898967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 483/951] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:12 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:13.922898 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:13.924150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:13.931045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:13.931611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:13.932255 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:13.932957 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:13.933467 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:13.934116 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:13.964516 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8f62297-d68a-481d-af9f-d4c474f11d42"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:13.967321 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:13.974366 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:13.974864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:13.975305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:13.976040 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:13.976497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:13.976928 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:14.166132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:14.174572 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:14.178543 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ecbc470f-7cc0-4852-abd5-9fadc8b4976a tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.261144 Sep 12 23:36:14.179195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 469/952] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:13 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:14.266226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9f10eb18-808a-4a87-a099-0b34951ef3d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305652 Sep 12 23:36:14.266865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 484/953] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:36:13 2022] POST /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:15.203588 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:15.204127 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:15.211425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:15.211939 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:15.212372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:15.213050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:15.213494 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:15.213907 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:15.346065 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:15.353571 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-216a054f-80ba-4e87-a826-95d9d924acfd tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.154666 Sep 12 23:36:15.354128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 470/954] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:15 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:16.377455 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:16.378826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:16.385075 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:16.385561 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:16.386020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:16.386775 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:16.387151 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:16.387602 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:16.529973 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:16.538106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0720b614-5da4-4589-ba5c-9828c808d6e2 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.165501 Sep 12 23:36:16.538688 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 485/955] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:16 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:17.560913 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:17.562190 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:17.569617 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:17.570200 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:17.570729 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:17.571492 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:17.572202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:17.572837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:17.720003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:17.728054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4d490e7b-657c-479c-a6dd-70ced0f1d4fe tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.170871 Sep 12 23:36:17.728619 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 471/956] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:17 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:18.753644 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:18.754963 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:18.761462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:18.761977 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:18.762441 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:18.763157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:18.763677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:18.764056 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:18.909150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:18.917916 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6b009bbe-0bb0-4258-a2a1-d2d0d66ca5e5 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.168042 Sep 12 23:36:18.918494 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 486/957] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:18 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:19.772358 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-78275a0d-2b73-4373-9ba0-6ff900b2f8ed req-9f0edb4e-d7e4-45b4-bd9f-1874120edeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb291d6-b18d-4241-b659-50cf940eb227", "name": "network-vif-plugged", "status": "completed", "tag": "9161919b-1838-4c64-a5a8-de22e08e110b"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:19.783680 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-78275a0d-2b73-4373-9ba0-6ff900b2f8ed req-9f0edb4e-d7e4-45b4-bd9f-1874120edeaa service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:19.784409 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-78275a0d-2b73-4373-9ba0-6ff900b2f8ed req-9f0edb4e-d7e4-45b4-bd9f-1874120edeaa service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:19.784846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-78275a0d-2b73-4373-9ba0-6ff900b2f8ed req-9f0edb4e-d7e4-45b4-bd9f-1874120edeaa service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:19.940803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:19.941462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:19.948237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:19.948758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:19.949119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-78275a0d-2b73-4373-9ba0-6ff900b2f8ed req-9f0edb4e-d7e4-45b4-bd9f-1874120edeaa service nova] Creating event network-vif-plugged:9161919b-1838-4c64-a5a8-de22e08e110b for instance afb291d6-b18d-4241-b659-50cf940eb227 on hv-cinder-85200 Sep 12 23:36:19.949235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:19.949890 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:19.950341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:19.950764 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:19.954118 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-78275a0d-2b73-4373-9ba0-6ff900b2f8ed req-9f0edb4e-d7e4-45b4-bd9f-1874120edeaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186228 Sep 12 23:36:19.955067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 472/958] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:36:20.088761 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:20.096779 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ec74eeb7-4595-4497-a9fa-3297c42572a4 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.159858 Sep 12 23:36:20.097349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 487/959] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:19 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:36:21.120964 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:21.121648 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:21.128180 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:21.128787 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:21.129081 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:21.129747 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:21.130193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:21.130608 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:21.259397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:21.266909 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-94df4db0-21b9-4116-8f96-a32617aa5a4f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1266 microversion: 2.1 time: 0.150198 Sep 12 23:36:21.267453 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 473/960] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:21 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:21.722403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:21.722882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:21.729281 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:21.729758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:21.730189 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:21.730879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:21.731329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:21.731918 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:21.808915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:21.813145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lazy-loading 'services' on Instance uuid a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:36:21.885182 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-125cf804-e141-41c8-863e-1d4e7a45021d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5/os-volume_attachments/e1802443-302c-4091-9a9f-9b79cfb74b14" status: 202 len: 0 microversion: 2.1 time: 0.166530 Sep 12 23:36:21.885780 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 488/961] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:36:21 2022] DELETE /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5/os-volume_attachments/e1802443-302c-4091-9a9f-9b79cfb74b14 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:36:22.290166 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:22.290709 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:22.296938 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:22.297414 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:22.297841 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:22.298516 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:22.298960 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:22.299375 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:22.427683 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:22.435202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c97e2bff-4a22-4830-b3a9-a54c9bad3c80 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1454 microversion: 2.1 time: 0.149003 Sep 12 23:36:22.435862 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 474/962] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:22 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:22.457369 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:22.458063 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:22.464046 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:22.464523 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:22.464952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:22.465627 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:22.466102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:22.466519 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:22.595222 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:22.603386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-78a5914b-3ad2-4ef0-a13c-748cdfcd451e tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1454 microversion: 2.1 time: 0.150179 Sep 12 23:36:22.603979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 489/963] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:22 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:23.961290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-84e7a4d0-723d-4d4f-9984-c6f6adc3dfe8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: .version_select at 0x7fa4b369d700>, body: {"keypair": {"name": "tempest-keypair-1313501269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiDgwfalXvHO6bKW5MyYc6i1/+E/2YU7miOseILfOrxK79sGDyoX19R1X/GddLO0rCAq4tPwieqH1XclgSYM8LSQucBAmvTv1zKoJ6Muj+yz6jhNTlHoXVezSUauYIWOQ=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:23.967633 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:23.981342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-84e7a4d0-723d-4d4f-9984-c6f6adc3dfe8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:36:23.985839 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-84e7a4d0-723d-4d4f-9984-c6f6adc3dfe8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:36:24.008965 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-84e7a4d0-723d-4d4f-9984-c6f6adc3dfe8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052234 Sep 12 23:36:24.009557 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 475/964] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:36:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:24.471436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-5149d991-60e7-4fb5-b850-5e18de61c6c2 req-9a5ed96a-8b12-4fd1-ad1d-3ecb346ba42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb291d6-b18d-4241-b659-50cf940eb227", "tag": "9161919b-1838-4c64-a5a8-de22e08e110b"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:24.478920 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:24.484180 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5149d991-60e7-4fb5-b850-5e18de61c6c2 req-9a5ed96a-8b12-4fd1-ad1d-3ecb346ba42e service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:24.484937 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5149d991-60e7-4fb5-b850-5e18de61c6c2 req-9a5ed96a-8b12-4fd1-ad1d-3ecb346ba42e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:24.485581 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-5149d991-60e7-4fb5-b850-5e18de61c6c2 req-9a5ed96a-8b12-4fd1-ad1d-3ecb346ba42e service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:24.499321 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-5149d991-60e7-4fb5-b850-5e18de61c6c2 req-9a5ed96a-8b12-4fd1-ad1d-3ecb346ba42e service nova] Creating event network-changed:9161919b-1838-4c64-a5a8-de22e08e110b for instance afb291d6-b18d-4241-b659-50cf940eb227 on hv-cinder-85200 Sep 12 23:36:24.505224 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-5149d991-60e7-4fb5-b850-5e18de61c6c2 req-9a5ed96a-8b12-4fd1-ad1d-3ecb346ba42e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037142 Sep 12 23:36:24.506409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 490/965] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:36:25.162419 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:25.163511 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:25.170846 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:25.171297 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:25.171770 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:25.172628 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:25.173080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:25.173503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:25.205148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:36:25.306876 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a8d0b4de-6cc8-4261-b94f-780c4d48cfc4 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 204 len: 0 microversion: 2.1 time: 0.151037 Sep 12 23:36:25.307520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 476/966] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:36:25 2022] DELETE /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:36:25.316515 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:25.317967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:25.324148 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:25.324628 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:25.325628 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:25.326319 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:25.326765 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:25.327183 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:25.482371 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:25.491325 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-96d0cc66-af42-481b-a5d2-6c96b1011e95 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1514 microversion: 2.1 time: 0.179093 Sep 12 23:36:25.491955 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 491/967] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:25 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:36:25.755698 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1725097376", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed4f9993-21de-4020-a46f-ad235aaa1a52"}], "security_groups": [{"name": "tempest-securitygroup--2137932391"}], "key_name": "tempest-keypair-1313501269", "user_data": "}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:25.857268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] validate_networks() for [('ed4f9993-21de-4020-a46f-ad235aaa1a52', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:36:26.216616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:36:26.217170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:36:26.217526 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:36:26.217927 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:36:26.218332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:36:26.227375 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:26.227881 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:26.228307 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:26.229023 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:26.229467 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:26.229883 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:26.246766 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:36:26.250663 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:36:26.261271 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:36:26.263608 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:36:26.308468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bf0ede1d-75ce-43ba-909b-73a1679924e0 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558091 Sep 12 23:36:26.309101 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 477/968] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:36:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:36:26.320236 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cb304b1c-0e2d-43f4-adcd-5b816bfab1c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:26.320868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cb304b1c-0e2d-43f4-adcd-5b816bfab1c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:26.375862 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cb304b1c-0e2d-43f4-adcd-5b816bfab1c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:26.382770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cb304b1c-0e2d-43f4-adcd-5b816bfab1c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1242 microversion: 2.1 time: 0.066454 Sep 12 23:36:26.383335 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 492/969] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:26 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:26.515354 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:26.516093 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:26.522844 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:26.523430 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:26.523900 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:26.524579 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:26.525025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:26.525473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:26.656014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:26.664875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-55009f0a-6140-4c94-b1d0-ee01aa5f157f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1514 microversion: 2.1 time: 0.153378 Sep 12 23:36:26.665423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 478/970] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:26 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:27.405648 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:27.406261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:27.414376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:27.414863 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:27.415297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:27.416018 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:27.416488 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:27.416888 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:27.478734 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:27.488921 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8f73f209-fa00-4e20-9622-ba0b0530f530 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1294 microversion: 2.1 time: 0.087159 Sep 12 23:36:27.489507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 493/971] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:27 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:27.637496 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-7d6f817e-11c7-4e05-8eee-cb5ad728451b req-fff75d06-fcfe-46e7-b72d-fafface24c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97fd6b9-4088-45a5-94a2-3a284e0dd3c5", "name": "network-vif-deleted", "tag": "c8c4cd5d-2829-4eda-9d53-9a41f69d724d"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:27.653161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-7d6f817e-11c7-4e05-8eee-cb5ad728451b req-fff75d06-fcfe-46e7-b72d-fafface24c3a service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:27.653946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-7d6f817e-11c7-4e05-8eee-cb5ad728451b req-fff75d06-fcfe-46e7-b72d-fafface24c3a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:27.654398 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-7d6f817e-11c7-4e05-8eee-cb5ad728451b req-fff75d06-fcfe-46e7-b72d-fafface24c3a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:27.665655 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-7d6f817e-11c7-4e05-8eee-cb5ad728451b req-fff75d06-fcfe-46e7-b72d-fafface24c3a service nova] Creating event network-vif-deleted:c8c4cd5d-2829-4eda-9d53-9a41f69d724d for instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 on hv-cinder-85200 Sep 12 23:36:27.671927 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-7d6f817e-11c7-4e05-8eee-cb5ad728451b req-fff75d06-fcfe-46e7-b72d-fafface24c3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038194 Sep 12 23:36:27.672753 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 479/972] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:27.689861 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:27.691349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:27.700173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:27.701229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:27.701889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:27.703201 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:27.704010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:27.704839 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:27.797630 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:27.806948 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-abb2cd02-407a-4135-8432-696cb277fd37 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 200 len: 1304 microversion: 2.1 time: 0.121339 Sep 12 23:36:27.807896 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 494/973] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:27 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:28.512299 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:28.513256 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:28.521278 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:28.521800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:28.522668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:28.523371 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:28.524043 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:28.524682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:28.669260 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:28.677360 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2a995938-99dc-4003-934e-9009a021cdf7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.169168 Sep 12 23:36:28.678356 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 480/974] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:28 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:28.829488 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:28.830095 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: a97fd6b9-4088-45a5-94a2-3a284e0dd3c5] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:28.836790 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:28.837356 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:28.837912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:28.838800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:28.839254 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:28.839701 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:28.853315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] HTTP exception thrown: Instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 could not be found. Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Request method failure captured: Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 HTTP/1.1 Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8I-_8vU17pRVXNCjjPIHTKV5ntER2Je6JaiyqwCrlsgvXpBQt4b7-J3_jT9V8v53nTvluwG2tAMX1dErcmsdb7GDPGb4N-CosdexjQM0VywRhBhdyWdnZV-aaYHZnJsJWayjudFhVwAnIJtaYsCFOo7hPZ_55V3aK0XAw1QKmLzNNA Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 24ded699e3a3432cbe1656777da8f958 Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1340425783 Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:36:28.854972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24ded699e3a3432cbe1656777da8f958", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24ded699e3a3432cbe1656777da8f958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24ded699e3a3432cbe1656777da8f958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24ded699e3a3432cbe1656777da8f958"}]}] Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-VolumesSnapshotTestJSON-1340425783 Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 24ded699e3a3432cbe1656777da8f958 Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1340425783 Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-VolumesSnapshotTestJSON-1340425783-project Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: b72692bbe1e9455db47a1b7e5995c01c Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-VolumesSnapshotTestJSON-1340425783-project Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 could not be found. Sep 12 23:36:28.856813 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'a97fd6b9-4088-45a5-94a2-3a284e0dd3c5'} Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 could not be found. Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:36:28.857825 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 could not be found. Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 could not be found. Sep 12 23:36:28.859398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:36:28.860827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Returning 404 to user: Instance a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:36:28.860827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-93bd80e9-d838-4ec8-b9a6-c76f448946c8 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5" status: 404 len: 111 microversion: 2.1 time: 0.030781 Sep 12 23:36:28.860827 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 495/975] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:28 2022] GET /compute/v2.1/servers/a97fd6b9-4088-45a5-94a2-3a284e0dd3c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:36:29.181600 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-b63542db-563a-4491-ad57-dfdc791515d6 req-ddf3751b-7dc1-4432-a5f1-0ca943220c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea71363c-0405-42da-a51d-6b0730b61beb", "tag": "c156ad4c-e850-4913-babb-462a2e030e1c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:29.191221 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b63542db-563a-4491-ad57-dfdc791515d6 req-ddf3751b-7dc1-4432-a5f1-0ca943220c68 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:29.192352 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b63542db-563a-4491-ad57-dfdc791515d6 req-ddf3751b-7dc1-4432-a5f1-0ca943220c68 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:29.192853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-b63542db-563a-4491-ad57-dfdc791515d6 req-ddf3751b-7dc1-4432-a5f1-0ca943220c68 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:29.204464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-b63542db-563a-4491-ad57-dfdc791515d6 req-ddf3751b-7dc1-4432-a5f1-0ca943220c68 service nova] Creating event network-changed:c156ad4c-e850-4913-babb-462a2e030e1c for instance ea71363c-0405-42da-a51d-6b0730b61beb on hv-cinder-85200 Sep 12 23:36:29.209973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-b63542db-563a-4491-ad57-dfdc791515d6 req-ddf3751b-7dc1-4432-a5f1-0ca943220c68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033362 Sep 12 23:36:29.210650 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 481/976] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:36:29.701491 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:29.702208 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:29.708906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:29.709383 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:29.709811 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:29.710766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:29.711225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:29.711666 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:29.844225 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:29.852288 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-336a25ed-ffd4-4d3e-891f-54924aa54a21 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.154659 Sep 12 23:36:29.852852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 496/977] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:29 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:30.876788 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:30.877417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:30.884175 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:30.884655 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:30.885077 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:30.885758 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:30.886203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:30.886815 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:31.016700 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:31.024860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-acad9cce-28a8-4918-827b-d16ef847218b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.153068 Sep 12 23:36:31.025439 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 482/978] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:30 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:32.048044 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:32.048645 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:32.055029 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:32.055510 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:32.055985 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:32.056669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:32.057116 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:32.057537 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:32.237259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:32.244914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-91b00710-7961-47b5-b1fa-4a1996b97230 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.200751 Sep 12 23:36:32.245497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 497/979] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:32 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:33.268616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:33.269505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:33.276687 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:33.277357 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:33.278776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:33.280047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:33.280047 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:33.280543 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:33.420953 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:33.429160 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-73dbe949-4242-42b3-b01b-08622f3d8516 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.164478 Sep 12 23:36:33.429724 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 483/980] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:33 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:34.455720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:34.456476 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:34.465419 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:34.465976 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:34.466409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:34.467538 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:34.468462 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:34.469101 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:34.636355 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:34.643910 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7c041b8c-26c2-4700-ba13-38f7934d54ca tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.193879 Sep 12 23:36:34.644482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 498/981] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:34 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:35.667995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:35.668612 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:35.674514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:35.674985 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:35.675412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:35.676154 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:35.676625 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:35.677046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:35.804805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:35.812283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-80792562-8d14-47a0-94ea-c18abeab5def tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.148360 Sep 12 23:36:35.812838 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 484/982] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:35 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:36.836159 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:36.836794 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:36.839235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:36.844548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:36.845033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:36.845468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:36.846160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:36.846611 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:36.847035 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:36.977664 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:36.985162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-85b7f29d-cbc5-4a50-a4fe-5da388ae5de5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.153519 Sep 12 23:36:36.985720 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 499/983] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:36 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:37.949980 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-a72cdd01-c210-4aa3-8806-2cc5ce15bdec req-34731f7d-38b3-4fe7-9a6c-2a27be175322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea71363c-0405-42da-a51d-6b0730b61beb", "name": "network-vif-plugged", "status": "completed", "tag": "c156ad4c-e850-4913-babb-462a2e030e1c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:37.954923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:37.955593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=10 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:37.962577 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a72cdd01-c210-4aa3-8806-2cc5ce15bdec req-34731f7d-38b3-4fe7-9a6c-2a27be175322 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:37.963053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a72cdd01-c210-4aa3-8806-2cc5ce15bdec req-34731f7d-38b3-4fe7-9a6c-2a27be175322 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:37.963478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a72cdd01-c210-4aa3-8806-2cc5ce15bdec req-34731f7d-38b3-4fe7-9a6c-2a27be175322 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:37.975145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-a72cdd01-c210-4aa3-8806-2cc5ce15bdec req-34731f7d-38b3-4fe7-9a6c-2a27be175322 service nova] Creating event network-vif-plugged:c156ad4c-e850-4913-babb-462a2e030e1c for instance ea71363c-0405-42da-a51d-6b0730b61beb on hv-cinder-85200 Sep 12 23:36:37.980187 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-a72cdd01-c210-4aa3-8806-2cc5ce15bdec req-34731f7d-38b3-4fe7-9a6c-2a27be175322 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Sep 12 23:36:37.980761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 485/984] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:38.008112 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:38.009294 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:38.016171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:38.016682 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:38.017118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:38.017819 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:38.018269 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:38.018688 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:38.183971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:38.191647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2596e499-4c77-4046-9ab9-eac841bf6e68 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.187468 Sep 12 23:36:38.192710 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 500/985] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:38 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:38.770986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2038348000", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "networks": [{"uuid": "3c81539a-e58b-4e42-89a7-b99d91ff7988"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:38.824849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] validate_networks() for [('3c81539a-e58b-4e42-89a7-b99d91ff7988', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:36:39.169298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:36:39.169917 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:36:39.170202 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:36:39.170606 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:36:39.171010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:36:39.180193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:39.180665 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:39.181090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:39.181800 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:39.182247 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:39.182698 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:39.198565 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Getting quotas for project 24ded699e3a3432cbe1656777da8f958. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:36:39.202427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Getting quotas for user b72692bbe1e9455db47a1b7e5995c01c and project 24ded699e3a3432cbe1656777da8f958. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:36:39.213630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:36:39.214730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:39.215331 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:39.215997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:36:39.221588 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:39.222072 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:39.222495 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:39.223168 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:39.224186 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:39.224604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:39.260371 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1dca19b8-e744-4856-84f0-c8f23ccfe2bc tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493535 Sep 12 23:36:39.261005 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 486/986] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:36:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:36:39.272573 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0e2cd3db-17a7-4715-a8c5-ca172ebdb9f2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:39.273179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0e2cd3db-17a7-4715-a8c5-ca172ebdb9f2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:39.331053 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0e2cd3db-17a7-4715-a8c5-ca172ebdb9f2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:39.338552 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0e2cd3db-17a7-4715-a8c5-ca172ebdb9f2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1219 microversion: 2.1 time: 0.070511 Sep 12 23:36:39.343811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 487/987] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:39 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:36:39.377772 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:39.386814 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6dbce245-cab4-43c7-ae65-2a0e92412cfb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1368 microversion: 2.1 time: 0.175766 Sep 12 23:36:39.387309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 501/988] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:39 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:36:40.362109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:40.362722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:40.369955 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:40.370444 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:40.370880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:40.371597 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:40.372045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:40.372470 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:40.410094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:40.411201 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:40.417604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:40.418098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:40.418536 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:40.419234 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:40.419716 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:40.420143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:40.433089 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:40.440657 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a100dba1-a80a-48c1-80d9-46332c512b19 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1271 microversion: 2.1 time: 0.082357 Sep 12 23:36:40.441305 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 488/989] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:40 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:40.556989 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:40.564698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6a87c5f4-7f9f-4e23-af72-999e65ecdc98 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1557 microversion: 2.1 time: 0.158362 Sep 12 23:36:40.565367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 502/990] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:40 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:36:40.588666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:40.589392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:40.595539 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:40.596134 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:40.596641 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:40.597417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:40.597967 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:40.598982 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:40.684223 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b62c89da-88a8-4229-8e8a-e866bd438aea tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100287 Sep 12 23:36:40.685447 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 489/991] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:36:40 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:41.463329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:41.463952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:41.470828 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:41.471312 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:41.471787 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:41.472484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:41.472932 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:41.473350 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:41.882003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:41.895629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1fe3a2ec-8d58-4ddf-8816-381b7592fb6f tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1319 microversion: 2.1 time: 0.436218 Sep 12 23:36:41.897332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 503/992] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:41 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:41.913551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-284fb815-f43e-4385-9a22-ec8202653ffd req-edb12718-fef7-4950-9021-491ca4f2b8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea71363c-0405-42da-a51d-6b0730b61beb", "tag": "c156ad4c-e850-4913-babb-462a2e030e1c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:41.925096 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-284fb815-f43e-4385-9a22-ec8202653ffd req-edb12718-fef7-4950-9021-491ca4f2b8d5 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:41.925763 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-284fb815-f43e-4385-9a22-ec8202653ffd req-edb12718-fef7-4950-9021-491ca4f2b8d5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:41.926954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-284fb815-f43e-4385-9a22-ec8202653ffd req-edb12718-fef7-4950-9021-491ca4f2b8d5 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:41.938782 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-284fb815-f43e-4385-9a22-ec8202653ffd req-edb12718-fef7-4950-9021-491ca4f2b8d5 service nova] Creating event network-changed:c156ad4c-e850-4913-babb-462a2e030e1c for instance ea71363c-0405-42da-a51d-6b0730b61beb on hv-cinder-85200 Sep 12 23:36:41.944392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-284fb815-f43e-4385-9a22-ec8202653ffd req-edb12718-fef7-4950-9021-491ca4f2b8d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047194 Sep 12 23:36:41.944988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 490/993] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:42.320776 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-09b825c9-c012-4e96-8c7f-56b2675664a2 req-c530952f-7b0c-4ad2-8c65-59236d3cb529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb5e223-bada-4ef9-a2bb-aa87cb884c09", "tag": "dcd0cb0d-153d-49db-8025-f5fd7352af0f"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:42.333250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-09b825c9-c012-4e96-8c7f-56b2675664a2 req-c530952f-7b0c-4ad2-8c65-59236d3cb529 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:42.334217 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-09b825c9-c012-4e96-8c7f-56b2675664a2 req-c530952f-7b0c-4ad2-8c65-59236d3cb529 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:42.334879 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-09b825c9-c012-4e96-8c7f-56b2675664a2 req-c530952f-7b0c-4ad2-8c65-59236d3cb529 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:42.347550 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-09b825c9-c012-4e96-8c7f-56b2675664a2 req-c530952f-7b0c-4ad2-8c65-59236d3cb529 service nova] Creating event network-changed:dcd0cb0d-153d-49db-8025-f5fd7352af0f for instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 on hv-cinder-85200 Sep 12 23:36:42.357555 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-09b825c9-c012-4e96-8c7f-56b2675664a2 req-c530952f-7b0c-4ad2-8c65-59236d3cb529 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040626 Sep 12 23:36:42.358732 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 504/994] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:42.920338 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:42.921028 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:42.928068 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:42.928540 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:42.929064 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:42.929734 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:42.930179 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:42.930593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:43.064059 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:43.068475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:43.073775 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2c017fb1-4e86-48d8-bbb6-bbc2c29321db tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1319 microversion: 2.1 time: 0.157660 Sep 12 23:36:43.074333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 491/995] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:42 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:44.097240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:44.097945 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:44.104479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:44.104964 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:44.105400 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:44.106094 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:44.106545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:44.106972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:44.265982 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:44.274559 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b4d21416-486e-4ae9-9139-9875f72ff747 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1319 microversion: 2.1 time: 0.182075 Sep 12 23:36:44.275137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 505/996] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:44 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:45.298667 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:45.299226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:45.306870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:45.307341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:45.307813 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:45.308485 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:45.308930 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:45.309347 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:45.436039 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:45.443686 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6466ea32-6c6d-483f-aa0e-755e27ee4767 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1319 microversion: 2.1 time: 0.148925 Sep 12 23:36:45.444241 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 492/997] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:45 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:45.968632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-e050fa8c-f15b-4580-a8a8-535ec8b81ba1 req-a47a0faf-9098-4950-98b8-e1dab52aad5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb5e223-bada-4ef9-a2bb-aa87cb884c09", "name": "network-vif-plugged", "status": "completed", "tag": "dcd0cb0d-153d-49db-8025-f5fd7352af0f"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:45.979028 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-e050fa8c-f15b-4580-a8a8-535ec8b81ba1 req-a47a0faf-9098-4950-98b8-e1dab52aad5a service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:45.979531 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-e050fa8c-f15b-4580-a8a8-535ec8b81ba1 req-a47a0faf-9098-4950-98b8-e1dab52aad5a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:45.979988 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-e050fa8c-f15b-4580-a8a8-535ec8b81ba1 req-a47a0faf-9098-4950-98b8-e1dab52aad5a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:45.995642 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-e050fa8c-f15b-4580-a8a8-535ec8b81ba1 req-a47a0faf-9098-4950-98b8-e1dab52aad5a service nova] Creating event network-vif-plugged:dcd0cb0d-153d-49db-8025-f5fd7352af0f for instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 on hv-cinder-85200 Sep 12 23:36:46.001841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-e050fa8c-f15b-4580-a8a8-535ec8b81ba1 req-a47a0faf-9098-4950-98b8-e1dab52aad5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036876 Sep 12 23:36:46.002505 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 506/998] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:36:46.466590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:46.467201 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:46.474389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:46.474822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:46.475258 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:46.476062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:46.476510 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:46.476926 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:46.607514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:46.616139 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-de0a467a-2278-4b72-a2cf-e6336aaa6611 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1319 microversion: 2.1 time: 0.153404 Sep 12 23:36:46.616742 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 493/999] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:46 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:47.639820 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:47.640545 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:47.647375 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:47.647883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:47.648318 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:47.649001 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:47.649451 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:47.649870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:47.776943 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:47.784529 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-34068fc3-d557-4004-b15e-8805dc8c7a9e tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1319 microversion: 2.1 time: 0.149469 Sep 12 23:36:47.785097 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 507/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:47 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:48.808052 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:48.808662 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:48.815022 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:48.815505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:48.815971 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:48.816695 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:48.817148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:48.817573 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:48.951894 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:36:48.959507 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c7941c9a-4cf8-4fc9-a485-8ecf742c5a28 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1507 microversion: 2.1 time: 0.155300 Sep 12 23:36:48.960090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 494/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:36:48 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:36:48.981379 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee9669e8-8767-43ef-96d2-2d0b9f48d611", "device": "/dev/sdb"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:48.983788 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:48.990605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:48.991087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:48.991518 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:48.992228 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:48.992679 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:48.993102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:49.010629 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:49.226369 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6207fbbe-ac6e-43f0-b11c-cd1831c171ed tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "POST /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248713 Sep 12 23:36:49.226971 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 508/1002] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:36:48 2022] POST /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:52.098784 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1336849925"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:52.099332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:52.101126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:52.101796 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:52.107987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:52.108463 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:52.108890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:52.109563 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:52.110006 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:52.110427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:52.233466 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.network.security_group_api [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Removing security group 63a59ec2-8575-46a6-b974-b6a29ba9ece8 from port 850a1b4c-80ad-42f1-b159-f1b2f080b1ea Sep 12 23:36:52.540568 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-75fd8de5-06ae-4248-b15a-a168d603813a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/action" status: 202 len: 0 microversion: 2.1 time: 0.446158 Sep 12 23:36:52.541343 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 495/1003] 10.222.0.27 () {60 vars in 1278 bytes} [Mon Sep 12 23:36:52 2022] POST /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:36:52.552411 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-9328322d-4a8a-4e51-b5ba-dbacfb9b4c10 req-1536a199-7cf6-4589-98c0-0040a2afc369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "761f11ac-7169-4c25-9288-60b5bc3eed8a", "tag": "850a1b4c-80ad-42f1-b159-f1b2f080b1ea"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:52.563744 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-9328322d-4a8a-4e51-b5ba-dbacfb9b4c10 req-1536a199-7cf6-4589-98c0-0040a2afc369 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:52.564610 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-9328322d-4a8a-4e51-b5ba-dbacfb9b4c10 req-1536a199-7cf6-4589-98c0-0040a2afc369 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:52.565250 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-9328322d-4a8a-4e51-b5ba-dbacfb9b4c10 req-1536a199-7cf6-4589-98c0-0040a2afc369 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:52.578736 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-9328322d-4a8a-4e51-b5ba-dbacfb9b4c10 req-1536a199-7cf6-4589-98c0-0040a2afc369 service nova] Creating event network-changed:850a1b4c-80ad-42f1-b159-f1b2f080b1ea for instance 761f11ac-7169-4c25-9288-60b5bc3eed8a on hv-cinder-85200 Sep 12 23:36:52.585816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-9328322d-4a8a-4e51-b5ba-dbacfb9b4c10 req-1536a199-7cf6-4589-98c0-0040a2afc369 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038853 Sep 12 23:36:52.587047 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 509/1004] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:53.652866 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:53.653397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:53.659437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:53.660057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:53.661019 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:53.661726 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:53.662172 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:53.662590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:53.740402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lazy-loading 'services' on Instance uuid 761f11ac-7169-4c25-9288-60b5bc3eed8a {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:36:53.812765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6ff479df-ff24-4502-bf36-644ae16e0bf5 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "DELETE /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments/3e732a12-6f9e-44ce-b853-595bb5a9715a" status: 202 len: 0 microversion: 2.1 time: 0.164287 Sep 12 23:36:53.813362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 496/1005] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:36:53 2022] DELETE /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments/3e732a12-6f9e-44ce-b853-595bb5a9715a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:36:53.824406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:53.826754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:53.839731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:53.840538 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:53.841012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:53.841990 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:53.842468 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:53.842898 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:53.874870 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f45b9ef6-52c0-4eb6-80a2-63d553776322 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055345 Sep 12 23:36:53.875430 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 510/1006] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:36:53 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:54.603406 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-be0cb966-dae7-46d4-91c1-3d12998035fb req-b965099b-df48-47f6-82f0-f6b5143fe4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "761f11ac-7169-4c25-9288-60b5bc3eed8a", "tag": "850a1b4c-80ad-42f1-b159-f1b2f080b1ea"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:36:54.608478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:54.614585 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-be0cb966-dae7-46d4-91c1-3d12998035fb req-b965099b-df48-47f6-82f0-f6b5143fe4e9 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:54.615067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-be0cb966-dae7-46d4-91c1-3d12998035fb req-b965099b-df48-47f6-82f0-f6b5143fe4e9 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:54.615502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-be0cb966-dae7-46d4-91c1-3d12998035fb req-b965099b-df48-47f6-82f0-f6b5143fe4e9 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:54.627740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-be0cb966-dae7-46d4-91c1-3d12998035fb req-b965099b-df48-47f6-82f0-f6b5143fe4e9 service nova] Creating event network-changed:850a1b4c-80ad-42f1-b159-f1b2f080b1ea for instance 761f11ac-7169-4c25-9288-60b5bc3eed8a on hv-cinder-85200 Sep 12 23:36:54.633040 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-be0cb966-dae7-46d4-91c1-3d12998035fb req-b965099b-df48-47f6-82f0-f6b5143fe4e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033743 Sep 12 23:36:54.633795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 497/1007] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:54.888571 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:54.890744 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:54.895485 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=44 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:36:54.901697 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:54.902237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:54.902636 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:54.903324 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:54.904098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:54.904507 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:54.936984 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-20fb0932-be95-4d14-912b-76e33f2918aa tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052336 Sep 12 23:36:54.937557 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 511/1008] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:36:54 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:55.951562 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:55.953822 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:55.960438 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:55.960914 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:55.961341 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:55.962014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:55.962459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:55.962875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:55.991141 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5e45b25d-ed22-44b5-9624-c9765279fd6a tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Sep 12 23:36:55.991701 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 498/1009] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:36:55 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:36:57.003864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:57.005938 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:57.012407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:57.012889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:57.013324 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:57.014002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:57.014452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:57.014872 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:57.043085 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-7550af01-108c-4609-a1f0-ac5570cc7c2f tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043345 Sep 12 23:36:57.043647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 512/1010] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:36:56 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:36:57.054725 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:36:57.055212 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:36:57.061535 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:57.062006 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:57.062431 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:57.063111 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:36:57.063561 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:36:57.063998 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:36:57.136394 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] HTTP exception thrown: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a is not attached to volume 3e732a12-6f9e-44ce-b853-595bb5a9715a Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Request method failure captured: Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments/3e732a12-6f9e-44ce-b853-595bb5a9715a HTTP/1.1 Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8INwIPCwXO4EmSym3ZUY1F5CjV3gAezrKYCH-GAGgKhJykqkkVsxZSwbRuNgVtCessmCNel3LKzQtZSOhzq025QWAMi7zbG0I9bj7-8klQHrZPJGYp7nRdYJllOei9F0lqyVSJNO6OEl_qkLgBby_NBrMFFuJDGI8t1vvOvaCmMdXc Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 00950b4875f54197bf44bd1ffa353937 Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestMinimumBasicScenario-1750740515 Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:36:57.138739 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_00950b4875f54197bf44bd1ffa353937", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/00950b4875f54197bf44bd1ffa353937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00950b4875f54197bf44bd1ffa353937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00950b4875f54197bf44bd1ffa353937"}]}] Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestMinimumBasicScenario-1750740515 Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 00950b4875f54197bf44bd1ffa353937 Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1750740515 Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-TestMinimumBasicScenario-1750740515-project Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: dd6241594ed040ce85c4b017cc361894 Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestMinimumBasicScenario-1750740515-project Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:36:57.140435 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a is not attached to volume 3e732a12-6f9e-44ce-b853-595bb5a9715a Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'server_id': '761f11ac-7169-4c25-9288-60b5bc3eed8a', 'id': '3e732a12-6f9e-44ce-b853-595bb5a9715a'} Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3e732a12-6f9e-44ce-b853-595bb5a9715a. Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:36:57.141388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a is not attached to volume 3e732a12-6f9e-44ce-b853-595bb5a9715a Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a is not attached to volume 3e732a12-6f9e-44ce-b853-595bb5a9715a Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:36:57.142937 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Returning 404 to user: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a is not attached to volume 3e732a12-6f9e-44ce-b853-595bb5a9715a {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:36:57.144109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e44db5e5-0971-4767-ae5e-7f59f463d146 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "DELETE /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments/3e732a12-6f9e-44ce-b853-595bb5a9715a" status: 404 len: 154 microversion: 2.1 time: 0.090144 Sep 12 23:36:57.144109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 499/1011] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:36:57 2022] DELETE /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a/os-volume_attachments/3e732a12-6f9e-44ce-b853-595bb5a9715a => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:37:00.382912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:00.383449 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:00.390238 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:00.390711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:00.391138 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:00.392085 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:00.392531 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:00.392946 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:00.418147 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:37:00.493314 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-342a460f-382a-4a5b-ae82-2e2068309ff9 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "DELETE /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 204 len: 0 microversion: 2.1 time: 0.114397 Sep 12 23:37:00.494031 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 513/1012] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:37:00 2022] DELETE /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:00.502209 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:00.502821 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:00.509322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:00.509806 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:00.510242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:00.510925 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:00.511376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:00.511830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:00.643854 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:00.652374 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2722474f-ff61-445d-a4d4-68013ff6354e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1552 microversion: 2.1 time: 0.154120 Sep 12 23:37:00.652929 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 500/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:00 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:01.676656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:01.677345 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:01.683753 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:01.684236 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:01.684665 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:01.685349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:01.685796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:01.686215 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:01.819815 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:01.827336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-5fa6da82-1c50-4158-b459-cbe28adc5500 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1552 microversion: 2.1 time: 0.155674 Sep 12 23:37:01.827933 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 514/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:01 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:02.851227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:02.851863 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:02.858425 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:02.858905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:02.859339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:02.860067 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:02.860521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:02.860943 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:02.990291 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:02.997939 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dbf4ddb6-c854-42e9-b0be-5f6ada16fc7c tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1552 microversion: 2.1 time: 0.151174 Sep 12 23:37:02.998502 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 501/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:02 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:04.019889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:04.020501 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:04.027191 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:04.027709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:04.028150 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:04.028844 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:04.029287 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:04.029704 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:04.158157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:04.165772 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2786490d-95b1-49da-8c3a-e4d6d8c8d596 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1552 microversion: 2.1 time: 0.149778 Sep 12 23:37:04.166339 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 515/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:04 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:05.018293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-764e3bf7-d634-4614-bd4c-5f4866f6d760 req-13aac43c-e3ec-488e-b49d-826ef6e2a8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "761f11ac-7169-4c25-9288-60b5bc3eed8a", "name": "network-vif-deleted", "tag": "850a1b4c-80ad-42f1-b159-f1b2f080b1ea"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:05.035000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-764e3bf7-d634-4614-bd4c-5f4866f6d760 req-13aac43c-e3ec-488e-b49d-826ef6e2a8ef service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:05.035402 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-764e3bf7-d634-4614-bd4c-5f4866f6d760 req-13aac43c-e3ec-488e-b49d-826ef6e2a8ef service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:05.035932 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-764e3bf7-d634-4614-bd4c-5f4866f6d760 req-13aac43c-e3ec-488e-b49d-826ef6e2a8ef service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:05.050630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-764e3bf7-d634-4614-bd4c-5f4866f6d760 req-13aac43c-e3ec-488e-b49d-826ef6e2a8ef service nova] Creating event network-vif-deleted:850a1b4c-80ad-42f1-b159-f1b2f080b1ea for instance 761f11ac-7169-4c25-9288-60b5bc3eed8a on hv-cinder-85200 Sep 12 23:37:05.057165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-764e3bf7-d634-4614-bd4c-5f4866f6d760 req-13aac43c-e3ec-488e-b49d-826ef6e2a8ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044963 Sep 12 23:37:05.057778 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 502/1017] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:05.189054 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:05.189668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:05.196524 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:05.197008 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:05.197446 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:05.198137 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:05.198592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:05.199023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:05.230171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:05.230657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:05.231098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:05.231546 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lazy-loading 'fault' on Instance uuid 761f11ac-7169-4c25-9288-60b5bc3eed8a {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:37:05.274261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd6241594ed040ce85c4b017cc361894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00950b4875f54197bf44bd1ffa353937', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:05.282643 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-c9975b3a-3995-4179-812c-166afa0e46ab tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 200 len: 1347 microversion: 2.1 time: 0.097329 Sep 12 23:37:05.284011 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 516/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:05 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 1347 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:06.307527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:06.308242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] [instance: 761f11ac-7169-4c25-9288-60b5bc3eed8a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:06.314673 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:06.315147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:06.315604 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:06.316277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:06.316721 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:06.317137 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:06.331616 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] HTTP exception thrown: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a could not be found. Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Request method failure captured: Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a HTTP/1.1 Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8INwIPCwXO4EmSym3ZUY1F5CjV3gAezrKYCH-GAGgKhJykqkkVsxZSwbRuNgVtCessmCNel3LKzQtZSOhzq025QWAMi7zbG0I9bj7-8klQHrZPJGYp7nRdYJllOei9F0lqyVSJNO6OEl_qkLgBby_NBrMFFuJDGI8t1vvOvaCmMdXc Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 00950b4875f54197bf44bd1ffa353937 Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestMinimumBasicScenario-1750740515 Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:37:06.333198 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_00950b4875f54197bf44bd1ffa353937", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/00950b4875f54197bf44bd1ffa353937"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00950b4875f54197bf44bd1ffa353937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/00950b4875f54197bf44bd1ffa353937"}]}] Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestMinimumBasicScenario-1750740515 Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 00950b4875f54197bf44bd1ffa353937 Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1750740515 Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-TestMinimumBasicScenario-1750740515-project Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: dd6241594ed040ce85c4b017cc361894 Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestMinimumBasicScenario-1750740515-project Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a could not be found. Sep 12 23:37:06.334860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '761f11ac-7169-4c25-9288-60b5bc3eed8a'} Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a could not be found. Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:37:06.335918 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a could not be found. Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a could not be found. Sep 12 23:37:06.337468 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:06.339140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Returning 404 to user: Instance 761f11ac-7169-4c25-9288-60b5bc3eed8a could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:37:06.339140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8d3a69ab-6c10-420f-b4ef-9cbd7f9151f4 tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a" status: 404 len: 111 microversion: 2.1 time: 0.031210 Sep 12 23:37:06.339140 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 503/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:06 2022] GET /compute/v2.1/servers/761f11ac-7169-4c25-9288-60b5bc3eed8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:37:06.343193 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3da22913-9bb2-416a-b1cb-e1d41241108e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] Calling method '.version_select at 0x7fa4b3665c10>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:06.362852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3da22913-9bb2-416a-b1cb-e1d41241108e tempest-TestMinimumBasicScenario-1750740515 tempest-TestMinimumBasicScenario-1750740515-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-376892558" status: 202 len: 0 microversion: 2.1 time: 0.023428 Sep 12 23:37:06.363422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 517/1020] 10.222.0.27 () {58 vars in 1269 bytes} [Mon Sep 12 23:37:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-376892558 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:37:08.596163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:08.597391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:08.604191 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:08.604794 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:08.605320 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:08.606115 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:08.606658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:08.607171 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:08.700031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lazy-loading 'services' on Instance uuid 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:37:08.788411 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5a4ea4a9-bc3c-44c2-af05-2ca65dd6093d tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09/os-volume_attachments/ee9669e8-8767-43ef-96d2-2d0b9f48d611" status: 202 len: 0 microversion: 2.1 time: 0.195939 Sep 12 23:37:08.789066 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 504/1021] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:37:08 2022] DELETE /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09/os-volume_attachments/ee9669e8-8767-43ef-96d2-2d0b9f48d611 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:37:09.943698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:09.944230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:09.953122 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:09.953623 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:09.954226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:09.955331 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:09.957727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:09.958170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:09.990606 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:37:10.106884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-533dbb44-3481-4cd7-bec7-67952b8f4fa2 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 204 len: 0 microversion: 2.1 time: 0.176189 Sep 12 23:37:10.108512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 518/1022] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:37:09 2022] DELETE /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:10.117322 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:10.118062 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:10.125685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:10.126577 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:10.127293 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:10.128060 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:10.128505 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:10.129097 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:10.288655 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:10.296571 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a618edfb-0b28-47e2-a256-14495ba60c78 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1513 microversion: 2.1 time: 0.183578 Sep 12 23:37:10.297459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 505/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:10 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:37:11.321893 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:11.322478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:11.328816 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:11.329329 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:11.329757 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:11.330442 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:11.331452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:11.331904 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:11.514068 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:11.521883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9175305d-5f8d-4e11-b9f8-ed24d069b350 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1513 microversion: 2.1 time: 0.206858 Sep 12 23:37:11.522443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 519/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:11 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:12.545428 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:12.545964 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:12.552416 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:12.552896 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:12.553326 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:12.554015 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:12.554458 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:12.554877 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:12.709842 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72692bbe1e9455db47a1b7e5995c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ded699e3a3432cbe1656777da8f958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:12.718157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-49b43d62-0609-436a-a34a-156204bafab9 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 200 len: 1513 microversion: 2.1 time: 0.176570 Sep 12 23:37:12.718736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 506/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:12 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:12.937962 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-66d3e232-01ab-4092-a5c0-a3a42c587f78 req-e53782b2-dc3d-467b-979a-9a4de610662b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb5e223-bada-4ef9-a2bb-aa87cb884c09", "name": "network-vif-deleted", "tag": "dcd0cb0d-153d-49db-8025-f5fd7352af0f"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:12.952091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-66d3e232-01ab-4092-a5c0-a3a42c587f78 req-e53782b2-dc3d-467b-979a-9a4de610662b service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:12.952894 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-66d3e232-01ab-4092-a5c0-a3a42c587f78 req-e53782b2-dc3d-467b-979a-9a4de610662b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:12.953374 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-66d3e232-01ab-4092-a5c0-a3a42c587f78 req-e53782b2-dc3d-467b-979a-9a4de610662b service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:12.966723 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-66d3e232-01ab-4092-a5c0-a3a42c587f78 req-e53782b2-dc3d-467b-979a-9a4de610662b service nova] Creating event network-vif-deleted:dcd0cb0d-153d-49db-8025-f5fd7352af0f for instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 on hv-cinder-85200 Sep 12 23:37:12.974376 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-66d3e232-01ab-4092-a5c0-a3a42c587f78 req-e53782b2-dc3d-467b-979a-9a4de610662b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040795 Sep 12 23:37:12.975243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 520/1026] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:13.742046 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:13.742812 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] [instance: 0bb5e223-bada-4ef9-a2bb-aa87cb884c09] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:13.749816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:13.750377 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:13.751029 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:13.751939 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:13.752525 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:13.753537 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:13.767686 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] HTTP exception thrown: Instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 could not be found. Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Request method failure captured: Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 HTTP/1.1 Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8I-_8vU17pRVXNCjjPIHTKV5ntER2Je6JaiyqwCrlsgvXpBQt4b7-J3_jT9V8v53nTvluwG2tAMX1dErcmsdb7GDPGb4N-CosdexjQM0VywRhBhdyWdnZV-aaYHZnJsJWayjudFhVwAnIJtaYsCFOo7hPZ_55V3aK0XAw1QKmLzNNA Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 24ded699e3a3432cbe1656777da8f958 Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1340425783 Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:37:13.769514 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24ded699e3a3432cbe1656777da8f958", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24ded699e3a3432cbe1656777da8f958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24ded699e3a3432cbe1656777da8f958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24ded699e3a3432cbe1656777da8f958"}]}] Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesSnapshotTestJSON-1340425783 Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 24ded699e3a3432cbe1656777da8f958 Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1340425783 Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesSnapshotTestJSON-1340425783-project Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: b72692bbe1e9455db47a1b7e5995c01c Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesSnapshotTestJSON-1340425783-project Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 could not be found. Sep 12 23:37:13.771488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '0bb5e223-bada-4ef9-a2bb-aa87cb884c09'} Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 could not be found. Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:37:13.772362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 could not be found. Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 could not be found. Sep 12 23:37:13.773984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:13.775325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] Returning 404 to user: Instance 0bb5e223-bada-4ef9-a2bb-aa87cb884c09 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:37:13.775325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0a52bb45-0e5f-4027-ae0a-9122d56635b0 tempest-VolumesSnapshotTestJSON-1340425783 tempest-VolumesSnapshotTestJSON-1340425783-project] 10.222.0.27 "GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09" status: 404 len: 111 microversion: 2.1 time: 0.033837 Sep 12 23:37:13.775805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 507/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:13 2022] GET /compute/v2.1/servers/0bb5e223-bada-4ef9-a2bb-aa87cb884c09 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:37:26.575699 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:26.576271 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:26.578861 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:26.579500 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:26.586111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.586585 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.587013 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.587714 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.588162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.588575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.614032 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0c500e52-1cbd-4118-bf4d-587a17926535 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb/ips" status: 200 len: 149 microversion: 2.1 time: 0.042501 Sep 12 23:37:26.614724 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 521/1028] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:37:26 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:26.626622 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8f62297-d68a-481d-af9f-d4c474f11d42"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:26.630491 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:26.633184 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=21 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:26.633853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:26.639530 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.640044 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.640464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.641147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.641593 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.642012 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.720764 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Invalid volume: volume d8f62297-d68a-481d-af9f-d4c474f11d42 is already attached to instances: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb/os-volume_attachments HTTP/1.1 Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 74 Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:37:26.722392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {"volumeAttachment": {"volumeId": "d8f62297-d68a-481d-af9f-d4c474f11d42"}} Sep 12 23:37:26.724126 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Invalid volume: volume d8f62297-d68a-481d-af9f-d4c474f11d42 is already attached to instances: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'server_id': 'ea71363c-0405-42da-a51d-6b0730b61beb', 'body': {'volumeAttachment': {'volumeId': 'd8f62297-d68a-481d-af9f-d4c474f11d42'}}} Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d8f62297-d68a-481d-af9f-d4c474f11d42 is already attached to instances: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:26.725119 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d8f62297-d68a-481d-af9f-d4c474f11d42 is already attached to instances: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:26.726599 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d8f62297-d68a-481d-af9f-d4c474f11d42 is already attached to instances: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 400 to user: Invalid volume: volume d8f62297-d68a-481d-af9f-d4c474f11d42 is already attached to instances: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5da88d33-7a8a-4762-88a1-c1c50a36825c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101287 Sep 12 23:37:26.728125 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 508/1029] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:37:26 2022] POST /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:37:26.733262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:26.733756 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:26.740194 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.740677 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.741041 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.741712 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.742158 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.742577 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.769881 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:37:26.842508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bd701b5f-100e-475d-9363-28533c6d23f7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 204 len: 0 microversion: 2.1 time: 0.112701 Sep 12 23:37:26.843196 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 522/1030] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:37:26 2022] DELETE /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:26.852452 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:26.853132 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:26.859951 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.860434 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.860868 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.862121 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:26.862574 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:26.862996 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:26.994920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:27.002654 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b3a32e40-0129-4fa9-b5fb-ea7a6f169c3d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1682 microversion: 2.1 time: 0.154683 Sep 12 23:37:27.003214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 509/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:26 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:28.026484 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:28.027200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:28.033547 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:28.034024 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:28.034452 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:28.035126 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:28.035591 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:28.036003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:28.162791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:28.171367 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a999f17d-c960-4172-9f02-78047f9d56c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1682 microversion: 2.1 time: 0.149098 Sep 12 23:37:28.171975 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 523/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:28 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:29.196240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:29.196951 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:29.212916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:29.213815 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:29.214478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:29.215204 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:29.215761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:29.216261 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:29.294147 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:29.303921 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e7530536-f69b-4121-84ea-29c1b3e7626f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 200 len: 1614 microversion: 2.1 time: 0.111367 Sep 12 23:37:29.305304 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 510/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:29 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 1614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:29.384575 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-99c1e764-ae7a-48b8-b24f-10e115387e41 req-87450aa3-e116-456e-9145-bc165e8aef28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea71363c-0405-42da-a51d-6b0730b61beb", "name": "network-vif-deleted", "tag": "c156ad4c-e850-4913-babb-462a2e030e1c"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:29.398926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-99c1e764-ae7a-48b8-b24f-10e115387e41 req-87450aa3-e116-456e-9145-bc165e8aef28 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:29.399406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-99c1e764-ae7a-48b8-b24f-10e115387e41 req-87450aa3-e116-456e-9145-bc165e8aef28 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:29.399867 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-99c1e764-ae7a-48b8-b24f-10e115387e41 req-87450aa3-e116-456e-9145-bc165e8aef28 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:29.412668 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-99c1e764-ae7a-48b8-b24f-10e115387e41 req-87450aa3-e116-456e-9145-bc165e8aef28 service nova] Creating event network-vif-deleted:c156ad4c-e850-4913-babb-462a2e030e1c for instance ea71363c-0405-42da-a51d-6b0730b61beb on hv-cinder-85200 Sep 12 23:37:29.417840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-99c1e764-ae7a-48b8-b24f-10e115387e41 req-87450aa3-e116-456e-9145-bc165e8aef28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040896 Sep 12 23:37:29.418431 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 524/1034] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:30.328811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:30.330077 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:30.337218 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:30.337756 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:30.338454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:30.339227 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:30.339767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:30.340195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:30.354949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb HTTP/1.1 Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:37:30.356581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:37:30.358339 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'ea71363c-0405-42da-a51d-6b0730b61beb'} Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:37:30.359163 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:37:30.360545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:30.361773 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:37:30.361773 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-58ee8b84-20d9-456a-8495-4b0a7b035493 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 404 len: 111 microversion: 2.1 time: 0.033422 Sep 12 23:37:30.361773 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 511/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:30 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:37:30.367403 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d16fd27e-8cee-40f0-abc6-683b522023c5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '.version_select at 0x7fa4b36ba0d0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:30.387961 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d16fd27e-8cee-40f0-abc6-683b522023c5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313501269" status: 202 len: 0 microversion: 2.1 time: 0.024744 Sep 12 23:37:30.388672 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 525/1036] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Sep 12 23:37:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1313501269 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:37:31.047362 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:31.047877 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:31.054441 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:31.054990 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:31.055427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:31.056185 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:31.056974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:31.057736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:31.139705 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lazy-loading 'services' on Instance uuid c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:37:31.209905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-49d06bbf-1a56-4d2e-8e8f-07ec9ba8d32b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments/d8f62297-d68a-481d-af9f-d4c474f11d42" status: 202 len: 0 microversion: 2.1 time: 0.166271 Sep 12 23:37:31.210490 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 512/1037] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:37:31 2022] DELETE /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments/d8f62297-d68a-481d-af9f-d4c474f11d42 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:37:31.219503 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:31.221952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:31.230459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:31.230955 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:31.231393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:31.232112 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:31.232732 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:31.233161 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:31.265649 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-2eb80ad0-1335-4797-ad07-e75c5fb75ebc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050763 Sep 12 23:37:31.266229 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 526/1038] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:37:31 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:32.278601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:32.280978 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:32.288023 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:32.288503 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:32.288928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:32.289603 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:32.290045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:32.290460 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:32.318556 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b55bff6c-59cb-4081-a39f-eb3cb3f44fce tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044215 Sep 12 23:37:32.319092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 513/1039] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:37:32 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:37:32.381437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:32.381959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:32.387947 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:32.388433 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:32.388865 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:32.389557 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:32.390000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:32.390421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:32.417336 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:37:32.501486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-922e4c39-ff48-4c62-89f4-be54d8e57712 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 204 len: 0 microversion: 2.1 time: 0.123602 Sep 12 23:37:32.502012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 527/1040] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:37:32 2022] DELETE /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 23:37:32.509954 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:32.510557 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:32.516388 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:32.516859 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:32.517798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:32.518467 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:32.518912 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:32.519325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:32.653475 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:32.661827 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dd4c9eac-efc1-49b8-99d3-983469c984a6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1679 microversion: 2.1 time: 0.155655 Sep 12 23:37:32.662382 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 514/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:32 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:33.685499 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:33.686232 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:33.693320 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:33.693806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:33.694243 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:33.694928 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:33.695382 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:33.695846 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:33.831584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:33.839448 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b41b533d-420d-443b-b9d8-7eb5c1e708bd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1679 microversion: 2.1 time: 0.158057 Sep 12 23:37:33.840188 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 528/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:33 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:34.864644 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:34.865427 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:34.873601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:34.874103 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:34.874539 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:34.875271 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:34.875718 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:34.876149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:34.941311 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:34.950401 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6d8af0cd-0323-482f-b884-313092949088 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 200 len: 1612 microversion: 2.1 time: 0.092084 Sep 12 23:37:34.951614 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 515/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:34 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 1612 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:35.015349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-d6faf60f-e614-4a7a-8f1c-ad364c0f03d6 req-a4c19ad8-1131-4629-8ad1-bad2387878c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49", "name": "network-vif-deleted", "tag": "5a153622-8f69-4201-a53f-b4494737fcf9"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:35.034058 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-d6faf60f-e614-4a7a-8f1c-ad364c0f03d6 req-a4c19ad8-1131-4629-8ad1-bad2387878c7 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:35.034592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-d6faf60f-e614-4a7a-8f1c-ad364c0f03d6 req-a4c19ad8-1131-4629-8ad1-bad2387878c7 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:35.035304 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-d6faf60f-e614-4a7a-8f1c-ad364c0f03d6 req-a4c19ad8-1131-4629-8ad1-bad2387878c7 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:35.056182 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-d6faf60f-e614-4a7a-8f1c-ad364c0f03d6 req-a4c19ad8-1131-4629-8ad1-bad2387878c7 service nova] Creating event network-vif-deleted:5a153622-8f69-4201-a53f-b4494737fcf9 for instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 on hv-cinder-85200 Sep 12 23:37:35.064494 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-d6faf60f-e614-4a7a-8f1c-ad364c0f03d6 req-a4c19ad8-1131-4629-8ad1-bad2387878c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051669 Sep 12 23:37:35.067256 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 529/1044] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:35.975103 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:35.975841 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:35.982515 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:35.983087 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:35.983628 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:35.984389 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:35.985009 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:35.985398 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:36.001104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 HTTP/1.1 Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:37:36.002944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:37:36.004733 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49'} Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:37:36.005919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:37:36.007397 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:37:36.008729 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:37:36.008729 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-16d178d0-a362-4d69-b30c-10c93f8a8ae2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 404 len: 111 microversion: 2.1 time: 0.034842 Sep 12 23:37:36.013635 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 516/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:35 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:37:36.019049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-65d0064b-cc9f-435b-b747-194934b8f441 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '.version_select at 0x7fa4b36e2ca0>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:36.048603 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-65d0064b-cc9f-435b-b747-194934b8f441 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739365502" status: 202 len: 0 microversion: 2.1 time: 0.033092 Sep 12 23:37:36.053310 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 530/1046] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Sep 12 23:37:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739365502 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:37:36.674257 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cadd9042-1ffa-46d1-b608-c08abea72eff tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: .version_select at 0x7fa4b380f3a0>, body: {"keypair": {"name": "tempest-keypair-1072227196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkgTyvyQwi71PLkjnwRKmCNXrD6tyPAKEbgRNjxLsK6C454DUCqWOcYrx3C+0bp5rxPte5kN1H30KSmc6YeEyrIKhZV8QqyZXP2r5W6XcJHxgk8pE2Al4xyQzbobTlSlw=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:36.689880 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-cadd9042-1ffa-46d1-b608-c08abea72eff tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:37:36.693585 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-cadd9042-1ffa-46d1-b608-c08abea72eff tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:37:36.716449 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cadd9042-1ffa-46d1-b608-c08abea72eff tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046035 Sep 12 23:37:36.717043 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 517/1047] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:37:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:38.280038 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176209128", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed4f9993-21de-4020-a46f-ad235aaa1a52"}], "security_groups": [{"name": "tempest-securitygroup--1160370124"}], "key_name": "tempest-keypair-1072227196", "user_data": "}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:38.393618 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.network.neutron [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] validate_networks() for [('ed4f9993-21de-4020-a46f-ad235aaa1a52', None, None, None, None, None)] {{(pid=120622) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:37:38.760969 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:37:38.761392 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image limits 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:37:38.761868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:37:38.762273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image pref 0:0:0 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:37:38.762705 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.virt.hardware [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120622) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:37:38.771609 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:38.772091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:38.772551 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:38.773272 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:38.773723 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:38.774143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:38.790979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:37:38.794864 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:37:38.806216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Going to run 1 instances... {{(pid=120622) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:37:38.808601 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120622) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:37:38.855589 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-65ce5b79-85fb-4d8b-9110-98a2eb5bc031 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580585 Sep 12 23:37:38.856407 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 531/1048] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:37:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:37:38.868481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2e551bc4-8e32-4f4d-86f4-81387516326f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:38.869093 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2e551bc4-8e32-4f4d-86f4-81387516326f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:38.940626 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2e551bc4-8e32-4f4d-86f4-81387516326f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:38.948663 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2e551bc4-8e32-4f4d-86f4-81387516326f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1241 microversion: 2.1 time: 0.084511 Sep 12 23:37:38.949422 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 518/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:38 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:39.973003 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:39.973622 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:39.984143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:39.984640 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:39.985368 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:39.986087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:39.986700 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:39.987282 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:40.064139 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:40.071912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a6156f89-7cfc-4193-a45c-77801bc4683e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1299 microversion: 2.1 time: 0.104312 Sep 12 23:37:40.072498 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 532/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:39 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:37:41.098217 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:41.098831 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:41.105203 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:41.105678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:41.106107 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:41.106790 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:41.107240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:41.107969 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:41.243043 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:41.251122 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3f48ef70-c354-45ce-bb93-e5d0f662fb77 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1367 microversion: 2.1 time: 0.157420 Sep 12 23:37:41.251633 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 519/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:41 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:41.269851 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-2e343e70-07e0-4a65-831a-c1db37b16685 req-dbafb696-8534-4717-a0ba-eab480839e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5a5d378-ca74-4d8f-b458-e0d76a8af8d9", "tag": "e729c713-9bcb-461e-a100-2e610d2d8e6c"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:41.280528 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-2e343e70-07e0-4a65-831a-c1db37b16685 req-dbafb696-8534-4717-a0ba-eab480839e9a service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:41.281262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-2e343e70-07e0-4a65-831a-c1db37b16685 req-dbafb696-8534-4717-a0ba-eab480839e9a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:41.281698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-2e343e70-07e0-4a65-831a-c1db37b16685 req-dbafb696-8534-4717-a0ba-eab480839e9a service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:41.294139 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-2e343e70-07e0-4a65-831a-c1db37b16685 req-dbafb696-8534-4717-a0ba-eab480839e9a service nova] Creating event network-changed:e729c713-9bcb-461e-a100-2e610d2d8e6c for instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 on hv-cinder-85200 Sep 12 23:37:41.299425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-2e343e70-07e0-4a65-831a-c1db37b16685 req-dbafb696-8534-4717-a0ba-eab480839e9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032812 Sep 12 23:37:41.300069 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 533/1052] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:37:42.276262 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:42.276811 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:42.283157 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:42.283666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:42.284104 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:42.284791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:42.285268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:42.285692 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:42.410751 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:42.418312 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-12973f2f-5bae-4d44-85c1-77dc569661ee tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1367 microversion: 2.1 time: 0.145939 Sep 12 23:37:42.418866 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 520/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:42 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:43.442797 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:43.443522 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:43.449667 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:43.450155 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:43.450588 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:43.451269 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:43.451749 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:43.452173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:43.585899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:43.593426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-86d8afa1-c71c-4dfd-ac2c-c961dd3a2098 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1367 microversion: 2.1 time: 0.155366 Sep 12 23:37:43.594010 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 534/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:43 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:44.616974 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:44.617581 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:44.624009 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:44.624488 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:44.624919 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:44.625601 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:44.626043 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:44.627118 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:44.758296 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:44.765834 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6893dc08-0367-4b6f-a12d-c0d2603c871f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1367 microversion: 2.1 time: 0.152750 Sep 12 23:37:44.766377 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 521/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:44 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:45.789482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:45.790092 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:45.796443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:45.796915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:45.797341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:45.798633 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:45.799098 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:45.799516 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:45.927899 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:45.935553 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-565696ce-65d0-4276-b98f-cf52731f26b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1367 microversion: 2.1 time: 0.149888 Sep 12 23:37:45.936163 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 535/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:45 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:46.394967 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-c3676b53-f7ce-47af-84ad-84aa47ab8d64 req-a50dab8f-1d25-45d7-ba10-54fda40c9c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a5d378-ca74-4d8f-b458-e0d76a8af8d9", "name": "network-vif-plugged", "status": "completed", "tag": "e729c713-9bcb-461e-a100-2e610d2d8e6c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:46.406159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c3676b53-f7ce-47af-84ad-84aa47ab8d64 req-a50dab8f-1d25-45d7-ba10-54fda40c9c72 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:46.406672 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c3676b53-f7ce-47af-84ad-84aa47ab8d64 req-a50dab8f-1d25-45d7-ba10-54fda40c9c72 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:46.407492 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c3676b53-f7ce-47af-84ad-84aa47ab8d64 req-a50dab8f-1d25-45d7-ba10-54fda40c9c72 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:46.421527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-c3676b53-f7ce-47af-84ad-84aa47ab8d64 req-a50dab8f-1d25-45d7-ba10-54fda40c9c72 service nova] Creating event network-vif-plugged:e729c713-9bcb-461e-a100-2e610d2d8e6c for instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 on hv-cinder-85200 Sep 12 23:37:46.426775 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-c3676b53-f7ce-47af-84ad-84aa47ab8d64 req-a50dab8f-1d25-45d7-ba10-54fda40c9c72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036021 Sep 12 23:37:46.427428 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 522/1057] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:46.958278 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:46.958919 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:46.965309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:46.965787 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:46.966220 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:46.966905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:46.967356 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:46.967802 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:47.097510 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:47.105101 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-1f7a6af5-2afd-4a62-a38d-27f1cc5113bc tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1367 microversion: 2.1 time: 0.150735 Sep 12 23:37:47.105669 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 536/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:46 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:48.129716 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:48.130630 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:48.137417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:48.137905 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:48.138342 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:48.139481 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:48.139965 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:48.140390 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:48.273853 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:37:48.281535 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-31f5c4ae-eeee-4e14-bdfa-c9d86e1c5b85 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1556 microversion: 2.1 time: 0.156695 Sep 12 23:37:48.282095 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 523/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:37:48 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:37:48.304064 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:37:48.304608 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:37:48.311037 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:48.311514 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:48.311979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:48.312666 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:48.313118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:48.314079 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:48.388361 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-0ee68185-1e4f-4cbb-84e6-43b0f7b23ec5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088269 Sep 12 23:37:48.388958 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 537/1060] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:37:48 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:37:49.542006 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-034029c9-6819-4adb-b3e3-fa34a931b163 req-f9cffbe1-542e-47b6-bbdf-2367ced0cc82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5a5d378-ca74-4d8f-b458-e0d76a8af8d9", "tag": "e729c713-9bcb-461e-a100-2e610d2d8e6c"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:37:49.546928 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:49.554743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-034029c9-6819-4adb-b3e3-fa34a931b163 req-f9cffbe1-542e-47b6-bbdf-2367ced0cc82 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:37:49.555391 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-034029c9-6819-4adb-b3e3-fa34a931b163 req-f9cffbe1-542e-47b6-bbdf-2367ced0cc82 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:37:49.556031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-034029c9-6819-4adb-b3e3-fa34a931b163 req-f9cffbe1-542e-47b6-bbdf-2367ced0cc82 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:37:49.568073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-034029c9-6819-4adb-b3e3-fa34a931b163 req-f9cffbe1-542e-47b6-bbdf-2367ced0cc82 service nova] Creating event network-changed:e729c713-9bcb-461e-a100-2e610d2d8e6c for instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 on hv-cinder-85200 Sep 12 23:37:49.573316 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-034029c9-6819-4adb-b3e3-fa34a931b163 req-f9cffbe1-542e-47b6-bbdf-2367ced0cc82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036514 Sep 12 23:37:49.573960 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 524/1061] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:03.792143 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:03.793248 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:03.794962 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:03.795290 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:03.795752 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:03.796102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:03.801479 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:03.801663 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-fcd540e1-5018-4374-95a5-bffed0a07e36 req-49036006-86ff-4a7d-b2d3-1f21b95d495c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb291d6-b18d-4241-b659-50cf940eb227", "tag": "9161919b-1838-4c64-a5a8-de22e08e110b"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:03.801980 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:03.809592 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:03.811673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:03.811673 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:03.811922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fcd540e1-5018-4374-95a5-bffed0a07e36 req-49036006-86ff-4a7d-b2d3-1f21b95d495c service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:03.812034 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fcd540e1-5018-4374-95a5-bffed0a07e36 req-49036006-86ff-4a7d-b2d3-1f21b95d495c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:03.812343 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:03.812459 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fcd540e1-5018-4374-95a5-bffed0a07e36 req-49036006-86ff-4a7d-b2d3-1f21b95d495c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:03.813157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:03.813806 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:03.824057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-fcd540e1-5018-4374-95a5-bffed0a07e36 req-49036006-86ff-4a7d-b2d3-1f21b95d495c service nova] Creating event network-changed:9161919b-1838-4c64-a5a8-de22e08e110b for instance afb291d6-b18d-4241-b659-50cf940eb227 on hv-cinder-85200 Sep 12 23:38:03.831653 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-fcd540e1-5018-4374-95a5-bffed0a07e36 req-49036006-86ff-4a7d-b2d3-1f21b95d495c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037314 Sep 12 23:38:03.834767 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 525/1062] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:38:03.850928 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:38:03.946731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-6635aaf7-600c-4725-8227-418b616e6d16 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "DELETE /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 204 len: 0 microversion: 2.1 time: 0.153732 Sep 12 23:38:03.947895 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 538/1063] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:38:03 2022] DELETE /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:03.957712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:03.958545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:03.967805 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:03.968428 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:03.968916 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:03.970268 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:03.970989 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:03.971676 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:04.119369 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:04.127294 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8383e5c0-2f21-4b2e-948c-dd4c35e9395d tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1579 microversion: 2.1 time: 0.174878 Sep 12 23:38:04.127899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 526/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:03 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:05.153230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:05.153967 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:05.160359 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:05.160849 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:05.161287 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:05.161979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:05.162438 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:05.162863 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:05.359175 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:05.368216 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3a95e04f-37d2-43ad-852f-29c238e1ca78 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1579 microversion: 2.1 time: 0.220488 Sep 12 23:38:05.368791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 539/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:05 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1579 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:05.962131 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-cd454731-4113-4f66-aae6-b59d9dc4667d req-2fadfd44-0e4d-413a-bf7d-511af3b0d0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb291d6-b18d-4241-b659-50cf940eb227", "name": "network-vif-deleted", "tag": "9161919b-1838-4c64-a5a8-de22e08e110b"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:05.971837 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-cd454731-4113-4f66-aae6-b59d9dc4667d req-2fadfd44-0e4d-413a-bf7d-511af3b0d0a0 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:05.972313 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-cd454731-4113-4f66-aae6-b59d9dc4667d req-2fadfd44-0e4d-413a-bf7d-511af3b0d0a0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:05.972737 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-cd454731-4113-4f66-aae6-b59d9dc4667d req-2fadfd44-0e4d-413a-bf7d-511af3b0d0a0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:05.986426 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-cd454731-4113-4f66-aae6-b59d9dc4667d req-2fadfd44-0e4d-413a-bf7d-511af3b0d0a0 service nova] Creating event network-vif-deleted:9161919b-1838-4c64-a5a8-de22e08e110b for instance afb291d6-b18d-4241-b659-50cf940eb227 on hv-cinder-85200 Sep 12 23:38:05.991112 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-cd454731-4113-4f66-aae6-b59d9dc4667d req-2fadfd44-0e4d-413a-bf7d-511af3b0d0a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Sep 12 23:38:05.991722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 527/1066] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:06.400285 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:06.400959 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:06.409569 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:06.410111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:06.410727 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:06.411644 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:06.412189 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:06.412686 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:06.447898 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:06.448300 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:06.448735 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:06.449199 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lazy-loading 'fault' on Instance uuid afb291d6-b18d-4241-b659-50cf940eb227 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:38:06.490709 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:06.499101 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-cd65fabe-4bb6-44b1-8ea2-d0b49abee0b9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 200 len: 1231 microversion: 2.1 time: 0.103026 Sep 12 23:38:06.499889 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 540/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:06 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:07.523816 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:07.524504 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: afb291d6-b18d-4241-b659-50cf940eb227] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:07.530575 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:07.531045 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:07.531471 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:07.532174 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:07.532623 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:07.533061 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:07.546115 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] HTTP exception thrown: Instance afb291d6-b18d-4241-b659-50cf940eb227 could not be found. Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Request method failure captured: Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 HTTP/1.1 Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8EOwQouIPY7j8fm3ZX_1yIZ9C1lz3bj8er-4vZnMxrZmLbzfvNfwmbsYlYPHt9oCEqhl_UF4hDEPu4j3Sz416WydC7vglrUy639_4IIUo0Ujjzb3uabstNhUpz4zDFqZWwE_JjCqYpYy3OK7N8wwkMk6Tr7xZcy6r9LVkIfloWPUGQ Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:38:07.547769 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaa5d21fc40540e4b811713e5efeff46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}] Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 2d62232282dc4455834857d5290eb169 Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance afb291d6-b18d-4241-b659-50cf940eb227 could not be found. Sep 12 23:38:07.549478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'afb291d6-b18d-4241-b659-50cf940eb227'} Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb291d6-b18d-4241-b659-50cf940eb227 could not be found. Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:38:07.550454 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb291d6-b18d-4241-b659-50cf940eb227 could not be found. Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb291d6-b18d-4241-b659-50cf940eb227 could not be found. Sep 12 23:38:07.551890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:07.553206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Returning 404 to user: Instance afb291d6-b18d-4241-b659-50cf940eb227 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:38:07.553206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7bec251c-eb1d-4e5e-8c81-dc56557c0dba tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227" status: 404 len: 111 microversion: 2.1 time: 0.030240 Sep 12 23:38:07.553206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 528/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:07 2022] GET /compute/v2.1/servers/afb291d6-b18d-4241-b659-50cf940eb227 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:38:10.816530 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:10.817080 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:10.818534 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-9f1e8277-631e-49e0-8749-9038c7eed6c9 req-1d5f4bdd-f0d5-4d4f-bb4d-ba8dbea99e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37c4155-6a32-4c60-94f9-542d3beac5bd", "tag": "e122a07d-d119-4a70-9133-63ec543a476e"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:10.825103 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:10.825632 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:10.826079 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:10.826847 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:10.827332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:10.827966 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:10.829543 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9f1e8277-631e-49e0-8749-9038c7eed6c9 req-1d5f4bdd-f0d5-4d4f-bb4d-ba8dbea99e14 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:10.830329 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9f1e8277-631e-49e0-8749-9038c7eed6c9 req-1d5f4bdd-f0d5-4d4f-bb4d-ba8dbea99e14 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:10.831145 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9f1e8277-631e-49e0-8749-9038c7eed6c9 req-1d5f4bdd-f0d5-4d4f-bb4d-ba8dbea99e14 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:10.843107 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-9f1e8277-631e-49e0-8749-9038c7eed6c9 req-1d5f4bdd-f0d5-4d4f-bb4d-ba8dbea99e14 service nova] Creating event network-changed:e122a07d-d119-4a70-9133-63ec543a476e for instance f37c4155-6a32-4c60-94f9-542d3beac5bd on hv-cinder-85200 Sep 12 23:38:10.848211 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-9f1e8277-631e-49e0-8749-9038c7eed6c9 req-1d5f4bdd-f0d5-4d4f-bb4d-ba8dbea99e14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033494 Sep 12 23:38:10.849031 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 529/1069] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:10.854809 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:38:10.954386 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dffcbd9e-7fb0-4267-bbb2-3e6bb0bec5ca tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 204 len: 0 microversion: 2.1 time: 0.142320 Sep 12 23:38:10.959039 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 541/1070] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:38:10 2022] DELETE /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:10.963795 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:10.964646 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:10.970849 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:10.971332 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:10.971791 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:10.972478 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:10.972934 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:10.973353 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:11.124832 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:11.133361 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-83505da3-43c2-4ae3-a850-fddcdf49f989 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1578 microversion: 2.1 time: 0.173627 Sep 12 23:38:11.133950 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 530/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:10 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:38:12.158983 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:12.159830 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:12.166341 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:12.166917 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:12.167422 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:12.168273 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:12.168768 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:12.169200 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:12.300729 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:12.308726 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d6567527-bddf-4285-8bfc-85e4c1ce5d4b tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1578 microversion: 2.1 time: 0.154530 Sep 12 23:38:12.309303 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 542/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:12 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:12.977014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-d881b4bb-425e-418a-aa2a-cbbb25871086 req-f873eeab-1c02-440f-a29d-92ba4d96b44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37c4155-6a32-4c60-94f9-542d3beac5bd", "name": "network-vif-deleted", "tag": "e122a07d-d119-4a70-9133-63ec543a476e"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:12.987617 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d881b4bb-425e-418a-aa2a-cbbb25871086 req-f873eeab-1c02-440f-a29d-92ba4d96b44c service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:12.988099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d881b4bb-425e-418a-aa2a-cbbb25871086 req-f873eeab-1c02-440f-a29d-92ba4d96b44c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:12.988525 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-d881b4bb-425e-418a-aa2a-cbbb25871086 req-f873eeab-1c02-440f-a29d-92ba4d96b44c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:12.999633 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-d881b4bb-425e-418a-aa2a-cbbb25871086 req-f873eeab-1c02-440f-a29d-92ba4d96b44c service nova] Creating event network-vif-deleted:e122a07d-d119-4a70-9133-63ec543a476e for instance f37c4155-6a32-4c60-94f9-542d3beac5bd on hv-cinder-85200 Sep 12 23:38:13.004302 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-d881b4bb-425e-418a-aa2a-cbbb25871086 req-f873eeab-1c02-440f-a29d-92ba4d96b44c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031067 Sep 12 23:38:13.004875 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 531/1073] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:13.332087 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:13.332704 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:13.338972 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:13.339459 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:13.339926 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:13.340621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:13.341075 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:13.341497 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:13.381613 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:13.382111 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:13.382548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:13.382996 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lazy-loading 'fault' on Instance uuid f37c4155-6a32-4c60-94f9-542d3beac5bd {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:38:13.622508 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d62232282dc4455834857d5290eb169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa5d21fc40540e4b811713e5efeff46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:13.630262 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3f268246-487d-4a98-a2eb-32e936f142af tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 200 len: 1231 microversion: 2.1 time: 0.302185 Sep 12 23:38:13.630992 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 543/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:13 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 1231 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:14.654518 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:14.655204 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: f37c4155-6a32-4c60-94f9-542d3beac5bd] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:14.662000 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:14.662474 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:14.662903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:14.663603 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:14.664057 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:14.664470 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:14.677277 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] HTTP exception thrown: Instance f37c4155-6a32-4c60-94f9-542d3beac5bd could not be found. Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Request method failure captured: Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd HTTP/1.1 Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8EOwQouIPY7j8fm3ZX_1yIZ9C1lz3bj8er-4vZnMxrZmLbzfvNfwmbsYlYPHt9oCEqhl_UF4hDEPu4j3Sz416WydC7vglrUy639_4IIUo0Ujjzb3uabstNhUpz4zDFqZWwE_JjCqYpYy3OK7N8wwkMk6Tr7xZcy6r9LVkIfloWPUGQ Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:38:14.678879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaa5d21fc40540e4b811713e5efeff46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}] Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 2d62232282dc4455834857d5290eb169 Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance f37c4155-6a32-4c60-94f9-542d3beac5bd could not be found. Sep 12 23:38:14.680545 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'f37c4155-6a32-4c60-94f9-542d3beac5bd'} Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37c4155-6a32-4c60-94f9-542d3beac5bd could not be found. Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:38:14.681464 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37c4155-6a32-4c60-94f9-542d3beac5bd could not be found. Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37c4155-6a32-4c60-94f9-542d3beac5bd could not be found. Sep 12 23:38:14.683085 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:14.684611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Returning 404 to user: Instance f37c4155-6a32-4c60-94f9-542d3beac5bd could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:38:14.684611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a30e818c-aa50-450e-a6af-08abec2952ef tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd" status: 404 len: 111 microversion: 2.1 time: 0.030752 Sep 12 23:38:14.684611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 532/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:14 2022] GET /compute/v2.1/servers/f37c4155-6a32-4c60-94f9-542d3beac5bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:38:15.111053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:15.111548 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:15.117979 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:15.118458 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:15.118891 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:15.119587 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:15.120043 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:15.120465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:15.134131 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] HTTP exception thrown: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Request method failure captured: Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf HTTP/1.1 Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8EOwQouIPY7j8fm3ZX_1yIZ9C1lz3bj8er-4vZnMxrZmLbzfvNfwmbsYlYPHt9oCEqhl_UF4hDEPu4j3Sz416WydC7vglrUy639_4IIUo0Ujjzb3uabstNhUpz4zDFqZWwE_JjCqYpYy3OK7N8wwkMk6Tr7xZcy6r9LVkIfloWPUGQ Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:38:15.135824 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaa5d21fc40540e4b811713e5efeff46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}] Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 2d62232282dc4455834857d5290eb169 Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.137298 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': '712d2ca0-8999-4499-854b-b80c8cff71cf'} Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:38:15.138124 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.139593 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.141655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Returning 404 to user: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:38:15.141655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-78eae6f0-28e6-4e2e-a822-d74692b7676f tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "DELETE /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 404 len: 111 microversion: 2.1 time: 0.030075 Sep 12 23:38:15.141655 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 544/1076] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:38:15 2022] DELETE /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:38:15.146798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:15.147498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] [instance: 712d2ca0-8999-4499-854b-b80c8cff71cf] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:15.153400 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:15.153890 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:15.154327 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:15.155014 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:15.155487 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:15.155920 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:15.169372 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] HTTP exception thrown: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Request method failure captured: Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf HTTP/1.1 Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8EOwQouIPY7j8fm3ZX_1yIZ9C1lz3bj8er-4vZnMxrZmLbzfvNfwmbsYlYPHt9oCEqhl_UF4hDEPu4j3Sz416WydC7vglrUy639_4IIUo0Ujjzb3uabstNhUpz4zDFqZWwE_JjCqYpYy3OK7N8wwkMk6Tr7xZcy6r9LVkIfloWPUGQ Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:38:15.171036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eaa5d21fc40540e4b811713e5efeff46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eaa5d21fc40540e4b811713e5efeff46"}]}] Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: eaa5d21fc40540e4b811713e5efeff46 Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestVolumeBootPattern-2069738643 Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 2d62232282dc4455834857d5290eb169 Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestVolumeBootPattern-2069738643-project Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.172798 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': '712d2ca0-8999-4499-854b-b80c8cff71cf'} Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:38:15.173669 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. Sep 12 23:38:15.175167 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:15.176987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Returning 404 to user: Instance 712d2ca0-8999-4499-854b-b80c8cff71cf could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:38:15.176987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-506adee5-c773-4184-813b-7dc30f5de9d9 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf" status: 404 len: 111 microversion: 2.1 time: 0.030086 Sep 12 23:38:15.176987 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 533/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:15 2022] GET /compute/v2.1/servers/712d2ca0-8999-4499-854b-b80c8cff71cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:38:16.476106 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-f5fb9cac-003d-4914-ae49-2c8548372478 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] Calling method '.version_select at 0x7fa4b3858550>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:16.497193 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-f5fb9cac-003d-4914-ae49-2c8548372478 tempest-TestVolumeBootPattern-2069738643 tempest-TestVolumeBootPattern-2069738643-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1903603689" status: 202 len: 0 microversion: 2.1 time: 0.024678 Sep 12 23:38:16.497973 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 545/1078] 10.222.0.27 () {58 vars in 1263 bytes} [Mon Sep 12 23:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1903603689 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:38:25.617178 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:25.617743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:25.620128 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=18 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.620761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=26 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.627279 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:25.627793 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:25.628222 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:25.628899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:25.629346 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:25.629761 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:25.653143 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-96ee704a-c4ba-4469-905b-7d773ee81be7 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/ips" status: 200 len: 148 microversion: 2.1 time: 0.039937 Sep 12 23:38:25.653682 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 534/1079] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:38:25 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:26.984363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e0069c0-93f6-4dcb-9bfb-422833ef3a6c"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:26.987289 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:26.990095 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.990748 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.999693 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:27.000717 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:27.001162 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:27.001856 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:27.002313 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:27.002739 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:27.243924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-d647da12-607d-4a1d-b160-5851a022161c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263683 Sep 12 23:38:27.244519 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 546/1080] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:38:26 2022] POST /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:33.715867 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e0069c0-93f6-4dcb-9bfb-422833ef3a6c"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:33.718541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:33.724862 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:33.725340 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:33.725776 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:33.726457 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:33.726911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:33.727334 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:34.023658 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Invalid volume: volume 5e0069c0-93f6-4dcb-9bfb-422833ef3a6c is already attached to instances: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments HTTP/1.1 Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 74 Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:38:34.025252 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {"volumeAttachment": {"volumeId": "5e0069c0-93f6-4dcb-9bfb-422833ef3a6c"}} Sep 12 23:38:34.026902 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Invalid volume: volume 5e0069c0-93f6-4dcb-9bfb-422833ef3a6c is already attached to instances: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'server_id': 'd5a5d378-ca74-4d8f-b458-e0d76a8af8d9', 'body': {'volumeAttachment': {'volumeId': '5e0069c0-93f6-4dcb-9bfb-422833ef3a6c'}}} Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5e0069c0-93f6-4dcb-9bfb-422833ef3a6c is already attached to instances: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:34.027879 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5e0069c0-93f6-4dcb-9bfb-422833ef3a6c is already attached to instances: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:34.029165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5e0069c0-93f6-4dcb-9bfb-422833ef3a6c is already attached to instances: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 400 to user: Invalid volume: volume 5e0069c0-93f6-4dcb-9bfb-422833ef3a6c is already attached to instances: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a500e0c6-48e1-4806-9b73-989698a45082 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.314897 Sep 12 23:38:34.030437 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 535/1081] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:38:33 2022] POST /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments => generated 174 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:38:34.095119 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:34.095731 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:34.101863 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:34.102378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:34.102846 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:34.103538 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:34.104022 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:34.104443 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:34.185240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.objects.instance [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lazy-loading 'services' on Instance uuid d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 {{(pid=120622) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:38:34.255800 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-4cb3a446-7be1-41b5-841c-a902e1c52b8f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments/5e0069c0-93f6-4dcb-9bfb-422833ef3a6c" status: 202 len: 0 microversion: 2.1 time: 0.165218 Sep 12 23:38:34.256434 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 547/1082] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:38:34 2022] DELETE /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments/5e0069c0-93f6-4dcb-9bfb-422833ef3a6c => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:38:34.264922 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:34.267151 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:34.273691 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:34.274220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:34.274678 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:34.275452 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:34.275946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:34.276387 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:34.311050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a5bafb5a-5a4d-46b1-b03d-9ebb68b9a837 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050015 Sep 12 23:38:34.311923 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 536/1083] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:38:34 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:35.325570 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:35.327949 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:35.334567 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:35.335053 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:35.335465 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:35.336166 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:35.336607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:35.337023 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:35.364941 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-dccb0ecc-619d-47b6-ba4d-3872cb6b7f9e tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044187 Sep 12 23:38:35.365478 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 548/1084] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:38:35 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:38:35.427876 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:35.428396 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:35.434325 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:35.434807 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:35.435239 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:35.435957 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:35.436412 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:35.436857 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:35.463009 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:38:35.537499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3ca4db83-be60-4bb8-b309-b05c4178e1de tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 204 len: 0 microversion: 2.1 time: 0.112977 Sep 12 23:38:35.538076 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 537/1085] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:38:35 2022] DELETE /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:35.546715 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:35.547895 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:35.553689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:35.554171 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:35.554607 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:35.555290 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:35.555781 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:35.556206 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:35.682657 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:35.690854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-ea1b6b8e-cb28-4264-9fd1-4be667a6174c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1680 microversion: 2.1 time: 0.148012 Sep 12 23:38:35.691421 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 549/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:35 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:36.714557 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:36.715242 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:36.722080 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:36.722556 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:36.722984 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:36.723688 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:36.724138 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:36.724587 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:36.853973 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:36.861590 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-45b1909a-2e97-455c-94d5-5f3a37bcc165 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1680 microversion: 2.1 time: 0.151261 Sep 12 23:38:36.862155 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 538/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:36 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:37.828315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-37071f30-213d-4dc6-9e2c-cc85ce173a1e req-5a7c9420-71c8-4092-8f82-2857b7bd8a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a5d378-ca74-4d8f-b458-e0d76a8af8d9", "name": "network-vif-deleted", "tag": "e729c713-9bcb-461e-a100-2e610d2d8e6c"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:37.841177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-37071f30-213d-4dc6-9e2c-cc85ce173a1e req-5a7c9420-71c8-4092-8f82-2857b7bd8a87 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:37.841803 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-37071f30-213d-4dc6-9e2c-cc85ce173a1e req-5a7c9420-71c8-4092-8f82-2857b7bd8a87 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:37.842495 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-37071f30-213d-4dc6-9e2c-cc85ce173a1e req-5a7c9420-71c8-4092-8f82-2857b7bd8a87 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:37.858263 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-37071f30-213d-4dc6-9e2c-cc85ce173a1e req-5a7c9420-71c8-4092-8f82-2857b7bd8a87 service nova] Creating event network-vif-deleted:e729c713-9bcb-461e-a100-2e610d2d8e6c for instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 on hv-cinder-85200 Sep 12 23:38:37.865157 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-37071f30-213d-4dc6-9e2c-cc85ce173a1e req-5a7c9420-71c8-4092-8f82-2857b7bd8a87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041317 Sep 12 23:38:37.865906 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 550/1088] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:37.886910 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:37.888967 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:37.897020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:37.897740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:37.898498 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:37.899267 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:37.900092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:37.900760 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:37.994925 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:38.019455 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-41d86944-988d-4423-bc42-00607a871642 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 200 len: 1326 microversion: 2.1 time: 0.137820 Sep 12 23:38:38.020639 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 539/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:37 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 1326 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:39.043169 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:39.043812 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:39.050821 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:39.051299 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:39.051759 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:39.052435 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:39.052887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:39.053301 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:39.066557 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 HTTP/1.1 Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:38:39.068170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:38:39.069854 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'd5a5d378-ca74-4d8f-b458-e0d76a8af8d9'} Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:38:39.070835 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:38:39.072406 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:38:39.073770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:38:39.073770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b76e4e3b-d44e-4384-b8de-fe2ffa96bbfa tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 404 len: 111 microversion: 2.1 time: 0.030690 Sep 12 23:38:39.073770 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 551/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:39 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:38:39.080130 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1a2cdea5-3410-49c4-b2db-686148de112f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '.version_select at 0x7fa4b3708ee0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:39.099184 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1a2cdea5-3410-49c4-b2db-686148de112f tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072227196" status: 202 len: 0 microversion: 2.1 time: 0.024706 Sep 12 23:38:39.099766 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 540/1091] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Sep 12 23:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072227196 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:38:39.697924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-bee17410-6755-4e88-b80d-0cec77f71985 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: .version_select at 0x7fa4b373c430>, body: {"keypair": {"name": "tempest-keypair-1355595265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpJArE+XOz8jzTyOnVLeW95KluK8l5N+YF7dOewEvCfGeDJCB7NkykrdRVUjxJIzBJ0rt5mroxsKLf6XXKJWiyl6XWiSLihVycK5V/1j8thEkZii8/li8AFU72pqC7fFQ=="}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:39.713333 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-bee17410-6755-4e88-b80d-0cec77f71985 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:38:39.717241 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.quota [None req-bee17410-6755-4e88-b80d-0cec77f71985 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'key_pairs'} {{(pid=120622) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:38:39.741740 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-bee17410-6755-4e88-b80d-0cec77f71985 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047582 Sep 12 23:38:39.742433 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 552/1092] 10.222.0.27 () {60 vars in 1159 bytes} [Mon Sep 12 23:38:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:41.002267 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2028733666", "imageRef": "210b7a4c-de3f-4963-b392-db154dec3236", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed4f9993-21de-4020-a46f-ad235aaa1a52"}], "security_groups": [{"name": "tempest-securitygroup--592985034"}], "key_name": "tempest-keypair-1355595265", "user_data": "}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:41.103993 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] validate_networks() for [('ed4f9993-21de-4020-a46f-ad235aaa1a52', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:38:41.478527 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:38:41.478949 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:38:41.479421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:38:41.479864 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:38:41.480273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:38:41.489429 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:41.489901 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:41.490333 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:41.491050 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:41.491499 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:41.491946 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:41.509606 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:38:41.512944 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Getting quotas for user 81501360f082464191731f57d2b6a402 and project 1649d6cd95d4496baaee3a0c0595a304. Resources: {'instances', 'ram', 'cores'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:38:41.523857 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:38:41.526099 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='210b7a4c-de3f-4963-b392-db154dec3236',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:38:41.573312 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c32a67b2-f84c-43ed-a654-b5daf5aebc14 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.575636 Sep 12 23:38:41.574092 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 541/1093] 10.222.0.27 () {60 vars in 1147 bytes} [Mon Sep 12 23:38:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:38:41.585486 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-434e9d0d-48ac-40c0-92f2-7456420986b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:41.586167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-434e9d0d-48ac-40c0-92f2-7456420986b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:41.640678 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-434e9d0d-48ac-40c0-92f2-7456420986b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:41.647852 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-434e9d0d-48ac-40c0-92f2-7456420986b2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1242 microversion: 2.1 time: 0.066677 Sep 12 23:38:41.648409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 553/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:41 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:42.670903 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:42.671513 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:42.677528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:42.678003 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:42.678433 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:42.679110 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:42.679557 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:42.680001 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:42.742109 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:42.750392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b3ed6ba0-108f-405e-a1ff-d6d845e61f75 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1300 microversion: 2.1 time: 0.083354 Sep 12 23:38:42.751054 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 542/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:42 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:43.774621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:43.775878 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:43.782504 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:43.782994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:43.783425 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:43.784145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:43.784656 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:43.785118 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:43.999698 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:44.007841 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-701d8e83-fcd6-4025-b4cf-5dc2373965ed tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.237329 Sep 12 23:38:44.008418 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 554/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:43 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:44.052957 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-356c776e-08b8-47a9-bd43-b340106c1733 req-7e17463a-181a-41a0-a252-f00cdc5e089c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8745b2a-014b-42b0-8275-2b52e4ccb0a4", "tag": "4bf3512b-c0f1-4c6c-ad06-cdea620289cc"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:44.069371 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-356c776e-08b8-47a9-bd43-b340106c1733 req-7e17463a-181a-41a0-a252-f00cdc5e089c service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:44.070602 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-356c776e-08b8-47a9-bd43-b340106c1733 req-7e17463a-181a-41a0-a252-f00cdc5e089c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:44.071214 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-356c776e-08b8-47a9-bd43-b340106c1733 req-7e17463a-181a-41a0-a252-f00cdc5e089c service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:44.084528 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-356c776e-08b8-47a9-bd43-b340106c1733 req-7e17463a-181a-41a0-a252-f00cdc5e089c service nova] Creating event network-changed:4bf3512b-c0f1-4c6c-ad06-cdea620289cc for instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 on hv-cinder-85200 Sep 12 23:38:44.089418 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-356c776e-08b8-47a9-bd43-b340106c1733 req-7e17463a-181a-41a0-a252-f00cdc5e089c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042142 Sep 12 23:38:44.090007 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 543/1097] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:45.032261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:45.032874 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:45.039217 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:45.039766 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:45.040178 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:45.040858 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:45.041311 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:45.041730 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:45.245988 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:45.254173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-558385ea-074f-4180-bcda-5d2b7851cc3c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.225869 Sep 12 23:38:45.254743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 555/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:45 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:46.278292 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:46.278962 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:46.285966 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:46.286441 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:46.286874 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:46.287551 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:46.288025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:46.288466 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:46.421807 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:46.429223 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5c0b0a94-5256-4366-adf6-6c69c7a0e480 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.155825 Sep 12 23:38:46.429774 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 544/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:46 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:47.452109 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:47.452716 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:47.459853 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:47.460332 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:47.460760 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:47.461434 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:47.461882 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:47.462297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:47.589952 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:47.598167 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-565ee977-deb4-4ef5-ab08-5da96d3db400 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.149959 Sep 12 23:38:47.598734 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 556/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:47 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:48.620676 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:48.621319 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:48.628212 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:48.628713 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:48.629148 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:48.629845 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:48.630298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:48.630722 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:48.764891 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:48.773500 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-124a7eb3-6a21-4a48-893d-afd923cd5ddd tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.156696 Sep 12 23:38:48.774120 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 545/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:48 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:49.795213 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:49.795912 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:49.802412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:49.802887 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:49.803316 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:49.804024 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:49.804469 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:49.804886 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:49.937073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:49.944667 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-3b340b26-4e71-4ad0-934f-a7a7de7159e8 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.153330 Sep 12 23:38:49.945226 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 557/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:49 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:50.659520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-9b09e6e1-3356-4d3f-a80b-9b17c659d855 req-2876f302-a99d-4587-8f08-a37e279e1279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8745b2a-014b-42b0-8275-2b52e4ccb0a4", "name": "network-vif-plugged", "status": "completed", "tag": "4bf3512b-c0f1-4c6c-ad06-cdea620289cc"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:50.669520 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9b09e6e1-3356-4d3f-a80b-9b17c659d855 req-2876f302-a99d-4587-8f08-a37e279e1279 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:50.670002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9b09e6e1-3356-4d3f-a80b-9b17c659d855 req-2876f302-a99d-4587-8f08-a37e279e1279 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:50.670433 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9b09e6e1-3356-4d3f-a80b-9b17c659d855 req-2876f302-a99d-4587-8f08-a37e279e1279 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:50.682523 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-9b09e6e1-3356-4d3f-a80b-9b17c659d855 req-2876f302-a99d-4587-8f08-a37e279e1279 service nova] Creating event network-vif-plugged:4bf3512b-c0f1-4c6c-ad06-cdea620289cc for instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 on hv-cinder-85200 Sep 12 23:38:50.688403 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-9b09e6e1-3356-4d3f-a80b-9b17c659d855 req-2876f302-a99d-4587-8f08-a37e279e1279 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032560 Sep 12 23:38:50.689002 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 546/1103] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:38:50.967605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:50.968237 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:50.975006 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:50.975483 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:50.975956 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:50.976637 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:50.977082 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:50.977499 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:51.108223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:51.116447 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-12c969fa-1901-4261-bed2-c2374ce70c84 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.152764 Sep 12 23:38:51.117007 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 558/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:50 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:52.137544 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:52.138216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:52.142665 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:52.143347 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:52.150564 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:52.151041 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:52.151467 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:52.152165 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:52.152611 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:52.153025 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:52.291006 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:52.299090 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-34ff8c65-dffa-4b5a-b937-ab978d91aee4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1367 microversion: 2.1 time: 0.162584 Sep 12 23:38:52.299668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 547/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:52 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:53.322563 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:53.323129 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:53.325081 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell0:SELECT=6 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:53.333383 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:53.333908 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:53.334434 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:53.335358 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:53.336190 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:53.336788 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:53.462711 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:38:53.470349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-a82a32fb-5de7-441b-9887-f9688fd15015 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1556 microversion: 2.1 time: 0.151779 Sep 12 23:38:53.470924 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 559/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:38:53 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:53.492700 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:38:53.493195 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:38:53.499453 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:53.500583 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:53.501021 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:53.501712 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:53.502170 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:53.502600 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:53.577765 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-49925ce5-c18f-4959-9cbe-f18bee6ee2a3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088789 Sep 12 23:38:53.578381 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 548/1107] 10.222.0.27 () {58 vars in 1275 bytes} [Mon Sep 12 23:38:53 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:38:54.539083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [req-4d8878df-5cd6-4672-8d9f-e01a418c7f77 req-eb24081b-27b7-4cbf-88f0-42cfa58aa4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8745b2a-014b-42b0-8275-2b52e4ccb0a4", "tag": "4bf3512b-c0f1-4c6c-ad06-cdea620289cc"}]} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:38:54.548354 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-4d8878df-5cd6-4672-8d9f-e01a418c7f77 req-eb24081b-27b7-4cbf-88f0-42cfa58aa4a0 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:38:54.548905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-4d8878df-5cd6-4672-8d9f-e01a418c7f77 req-eb24081b-27b7-4cbf-88f0-42cfa58aa4a0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:38:54.549393 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [req-4d8878df-5cd6-4672-8d9f-e01a418c7f77 req-eb24081b-27b7-4cbf-88f0-42cfa58aa4a0 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:38:54.560242 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.compute.server_external_events [req-4d8878df-5cd6-4672-8d9f-e01a418c7f77 req-eb24081b-27b7-4cbf-88f0-42cfa58aa4a0 service nova] Creating event network-changed:4bf3512b-c0f1-4c6c-ad06-cdea620289cc for instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 on hv-cinder-85200 Sep 12 23:38:54.566259 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [req-4d8878df-5cd6-4672-8d9f-e01a418c7f77 req-eb24081b-27b7-4cbf-88f0-42cfa58aa4a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089638 Sep 12 23:38:54.567202 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 560/1108] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:39:24.810794 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.811732 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.816247 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:24.816736 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:24.824156 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:24.824668 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:24.825287 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:24.826020 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:24.826473 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:24.826897 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:24.853423 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3233f989-12c7-4464-8689-44bfdc64a3b6 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/ips" status: 200 len: 149 microversion: 2.1 time: 0.044010 Sep 12 23:39:24.853981 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 549/1109] 10.222.0.27 () {58 vars in 1248 bytes} [Mon Sep 12 23:39:24 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:39:26.176659 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52f01db7-3cef-4a27-800b-9fe0ef229c6c"}} {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:39:26.179706 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:26.181868 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:26.182512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG dbcounter [-] [120622] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:26.189083 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:26.189565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:26.190002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:26.190685 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:26.191140 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:26.191596 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:26.423774 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-589c9199-a10b-4f17-8bc3-7e17fbc62509 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "POST /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251514 Sep 12 23:39:26.424378 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 561/1110] 10.222.0.27 () {60 vars in 1323 bytes} [Mon Sep 12 23:39:26 2022] POST /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:39:32.995074 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:32.995622 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:33.001899 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:33.002379 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:33.002823 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:33.003521 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:33.003997 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:33.004421 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:33.083986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lazy-loading 'services' on Instance uuid a8745b2a-014b-42b0-8275-2b52e4ccb0a4 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:39:33.154436 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0dd2fbe1-ebfd-4359-8377-d8f5e41ab02b tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments/52f01db7-3cef-4a27-800b-9fe0ef229c6c" status: 202 len: 0 microversion: 2.1 time: 0.163057 Sep 12 23:39:33.155008 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 550/1111] 10.222.0.27 () {58 vars in 1416 bytes} [Mon Sep 12 23:39:32 2022] DELETE /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments/52f01db7-3cef-4a27-800b-9fe0ef229c6c => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:39:33.164605 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:33.166985 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:33.173390 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:33.173901 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:33.174349 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:33.175145 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:33.175625 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:33.176060 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:33.207405 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-8f9b6522-aed4-475c-8468-4c666662a772 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Sep 12 23:39:33.207994 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 562/1112] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:39:33 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:39:34.220815 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:34.223100 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:34.229280 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:34.229781 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:34.230220 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:34.230901 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:34.231357 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:34.231803 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:34.260206 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-155ddb97-d826-4b57-8faf-5356ede16953 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044287 Sep 12 23:39:34.260742 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 551/1113] 10.222.0.27 () {58 vars in 1302 bytes} [Mon Sep 12 23:39:34 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:39:34.322922 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:34.323436 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:34.329689 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:34.330172 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:34.330604 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:34.331275 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:34.331758 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:34.332177 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:34.356861 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Going to try to terminate instance {{(pid=120622) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:39:34.429160 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-38549a75-7ff3-4370-9b28-9c192985657c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 204 len: 0 microversion: 2.1 time: 0.110337 Sep 12 23:39:34.429754 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 563/1114] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:39:34 2022] DELETE /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:34.438216 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:34.438833 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:34.444693 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:34.445173 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:34.445605 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:34.446283 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:34.447229 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:34.447674 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:34.576385 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:39:34.584051 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5ab007c3-9f5c-4d56-bf9e-262bf32230eb tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1681 microversion: 2.1 time: 0.149937 Sep 12 23:39:34.584613 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 552/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:34 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:35.608002 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:35.608690 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:35.614936 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:35.615412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:35.615884 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:35.616564 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:35.617007 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:35.617423 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:35.751240 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:39:35.760263 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-89d156ef-97d1-4cad-9ee8-155e532d9561 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1681 microversion: 2.1 time: 0.156490 Sep 12 23:39:35.760826 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 564/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:35 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:36.785073 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:36.785791 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:36.795455 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:36.796012 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:36.796748 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:36.797565 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:36.798192 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:36.798646 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:36.854835 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-4bb39a18-9a55-47a5-b7dc-a7dee790ce1d req-d9590960-412e-496d-a71b-1a68684532a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8745b2a-014b-42b0-8275-2b52e4ccb0a4", "name": "network-vif-deleted", "tag": "4bf3512b-c0f1-4c6c-ad06-cdea620289cc"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:39:36.870547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-4bb39a18-9a55-47a5-b7dc-a7dee790ce1d req-d9590960-412e-496d-a71b-1a68684532a4 service nova] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:36.871740 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-4bb39a18-9a55-47a5-b7dc-a7dee790ce1d req-d9590960-412e-496d-a71b-1a68684532a4 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:36.872685 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-4bb39a18-9a55-47a5-b7dc-a7dee790ce1d req-d9590960-412e-496d-a71b-1a68684532a4 service nova] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:36.884512 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.policy [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81501360f082464191731f57d2b6a402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1649d6cd95d4496baaee3a0c0595a304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120622) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:39:36.889274 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-4bb39a18-9a55-47a5-b7dc-a7dee790ce1d req-d9590960-412e-496d-a71b-1a68684532a4 service nova] Creating event network-vif-deleted:4bf3512b-c0f1-4c6c-ad06-cdea620289cc for instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 on hv-cinder-85200 Sep 12 23:39:36.893584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-9392875d-e3c0-4619-bb26-bba383deb03c tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 200 len: 1327 microversion: 2.1 time: 0.112252 Sep 12 23:39:36.895482 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 565/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:36 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:39:36.915073 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-4bb39a18-9a55-47a5-b7dc-a7dee790ce1d req-d9590960-412e-496d-a71b-1a68684532a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149058 Sep 12 23:39:36.916069 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 553/1118] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Sep 12 23:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:39:37.920011 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:37.920621 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:37.926905 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:37.927381 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:37.927840 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:37.928556 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:37.929000 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:37.929415 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:37.942883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 HTTP/1.1 Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:39:37.944533 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:37.946309 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'a8745b2a-014b-42b0-8275-2b52e4ccb0a4'} Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:37.947398 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:37.949125 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:37.950746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:37.950746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-db083f7b-aad9-427a-b4d8-c39057ffd82d tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 404 len: 111 microversion: 2.1 time: 0.030310 Sep 12 23:39:37.950746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 566/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:37 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:37.958986 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-94896684-1930-4407-b840-88756c20fa27 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '.version_select at 0x7fa4b3859f70>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:37.976999 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-94896684-1930-4407-b840-88756c20fa27 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355595265" status: 202 len: 0 microversion: 2.1 time: 0.024591 Sep 12 23:39:37.977580 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 554/1120] 10.222.0.27 () {58 vars in 1221 bytes} [Mon Sep 12 23:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355595265 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:39:39.727687 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:39.728914 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:39.735284 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:39.735801 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:39.736235 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:39.736915 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:39.737364 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:39.737784 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:39.751091 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 HTTP/1.1 Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:39:39.752670 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.754276 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'a8745b2a-014b-42b0-8275-2b52e4ccb0a4'} Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:39.755223 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.756848 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.758363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:39.758363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-68c786e5-63d8-42f3-86f1-879803156042 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 404 len: 111 microversion: 2.1 time: 0.030640 Sep 12 23:39:39.758363 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 567/1121] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:39:39 2022] DELETE /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:39.762819 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:39.763550 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: a8745b2a-014b-42b0-8275-2b52e4ccb0a4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:39.770102 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:39.770583 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:39.771016 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:39.771995 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:39.772448 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:39.772870 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:39.786149 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 HTTP/1.1 Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:39:39.787785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.789392 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'a8745b2a-014b-42b0-8275-2b52e4ccb0a4'} Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:39.790281 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. Sep 12 23:39:39.792376 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:39.793860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance a8745b2a-014b-42b0-8275-2b52e4ccb0a4 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:39.793860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4a5b5d80-0138-47ba-800a-cabb636167d5 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4" status: 404 len: 111 microversion: 2.1 time: 0.030596 Sep 12 23:39:39.793860 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 555/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:39 2022] GET /compute/v2.1/servers/a8745b2a-014b-42b0-8275-2b52e4ccb0a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:40.926903 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:40.927397 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:40.934409 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:40.934883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:40.935305 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:40.936033 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:40.936470 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:40.936883 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:40.949993 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 HTTP/1.1 Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:39:40.951496 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.953261 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'd5a5d378-ca74-4d8f-b458-e0d76a8af8d9'} Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:40.954174 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.955796 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.957426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:40.957426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-153394c6-1ef0-41a8-88b4-ea9a4391f8c3 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 404 len: 111 microversion: 2.1 time: 0.029762 Sep 12 23:39:40.957426 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 568/1123] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:39:40 2022] DELETE /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:40.961161 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:40.961783 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: d5a5d378-ca74-4d8f-b458-e0d76a8af8d9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:40.968193 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:40.968666 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:40.969091 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:40.969762 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:40.970205 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:40.970617 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:40.984010 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 HTTP/1.1 Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:39:40.985497 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.987189 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'd5a5d378-ca74-4d8f-b458-e0d76a8af8d9'} Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:40.988159 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. Sep 12 23:39:40.989677 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:40.991226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:40.991226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1050d9de-c4e3-4893-9d8d-7f605199a7ef tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9" status: 404 len: 111 microversion: 2.1 time: 0.029536 Sep 12 23:39:40.991226 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 556/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:40 2022] GET /compute/v2.1/servers/d5a5d378-ca74-4d8f-b458-e0d76a8af8d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:40.995491 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:40.995999 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:41.001845 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:41.002315 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:41.002743 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:41.003412 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:41.003881 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:41.004297 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:41.017509 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb HTTP/1.1 Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:39:41.019020 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.020746 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'ea71363c-0405-42da-a51d-6b0730b61beb'} Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:41.021560 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.023102 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.024437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:41.024437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-b6165e06-52c5-4bbf-a6f3-6ebd1e0ba182 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 404 len: 111 microversion: 2.1 time: 0.029275 Sep 12 23:39:41.024437 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 569/1125] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:39:40 2022] DELETE /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:41.028927 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:41.029535 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: ea71363c-0405-42da-a51d-6b0730b61beb] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:41.035541 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:41.036048 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:41.036477 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:41.037150 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:41.037596 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:41.038011 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:41.051417 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb HTTP/1.1 Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:39:41.052933 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.054555 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'ea71363c-0405-42da-a51d-6b0730b61beb'} Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:41.055684 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. Sep 12 23:39:41.057830 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:41.059273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance ea71363c-0405-42da-a51d-6b0730b61beb could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:41.059273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b1cd4cf5-0620-4980-81fd-79d143cff4c2 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb" status: 404 len: 111 microversion: 2.1 time: 0.029150 Sep 12 23:39:41.059273 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 557/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:41 2022] GET /compute/v2.1/servers/ea71363c-0405-42da-a51d-6b0730b61beb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:42.190049 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:42.190584 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.compute.api [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120622) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:42.196987 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:42.198173 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:42.198647 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:42.199323 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:42.199815 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:42.200221 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG oslo_concurrency.lockutils [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:42.213230 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.wsgi [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: request: DELETE /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 HTTP/1.1 Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept: application/json Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Accept-Encoding: identity Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Connection: close Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Length: 0 Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Content-Type: application/json Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Host: 10.222.0.27 Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: Openstack-System-Scope: None Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Id: None Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Domain-Name: None Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Identity-Status: Confirmed Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Is-Admin-Project: True Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Id: default Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Domain-Name: Default Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Role: reader,member Sep 12 23:39:42.214737 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Roles: reader,member Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Id: default Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Domain-Name: Default Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: method: > Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: exception: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.217474 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: action_args: {'id': 'c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49'} Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: {{(pid=120622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:42.218586 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.220477 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.222170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: DEBUG nova.api.openstack.wsgi [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. {{(pid=120622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:42.222170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: INFO nova.api.openstack.requestlog [None req-37dd013d-32e2-4fb1-b821-ece91bd56846 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 404 len: 111 microversion: 2.1 time: 0.030129 Sep 12 23:39:42.222170 dv-cinder-852009-7-iscsi devstack@n-api.service[120622]: [pid: 120622|app: 0|req: 570/1127] 10.222.0.27 () {58 vars in 1239 bytes} [Mon Sep 12 23:39:42 2022] DELETE /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:39:42.224628 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:39:42.225240 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] [instance: c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:39:42.231790 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:42.232278 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:42.232743 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:42.233456 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Acquiring lock "96429caa-1467-4b07-a047-7b6621f3163f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:39:42.233911 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:39:42.234336 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Lock "96429caa-1467-4b07-a047-7b6621f3163f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:39:42.248036 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] HTTP exception thrown: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Request method failure captured: Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 HTTP/1.1 Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Connection: close Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Host: 10.222.0.27 Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjH8It_0TNyFhDJY-GQhBj_rH4XdzndaJc1ajXkpn1pPzUqznoJRLgEmRGNBK0IfaxUAN2r3Ap4GcZ2ZPrhVDWiwI72koaq34lvFey4twowDvch-oWhUixuLlT3WxJgZvTVXIJZhwhLvH4FeCwAfAwoD8KxE-eYzkY02XLSUCw9KukjtA Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 12 23:39:42.249547 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1649d6cd95d4496baaee3a0c0595a304", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1649d6cd95d4496baaee3a0c0595a304"}]}] Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 1649d6cd95d4496baaee3a0c0595a304 Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-553149905 Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Id: 81501360f082464191731f57d2b6a402 Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-553149905-project Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: method: > Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: exception: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.251298 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: action_args: {'id': 'c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49'} Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:39:42.252988 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. Sep 12 23:39:42.254785 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 12 23:39:42.256263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] Returning 404 to user: Instance c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:39:42.256263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5b12080f-958c-4a05-a244-d7b3cfb1efe4 tempest-AttachVolumeNegativeTest-553149905 tempest-AttachVolumeNegativeTest-553149905-project] 10.222.0.27 "GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49" status: 404 len: 111 microversion: 2.1 time: 0.030121 Sep 12 23:39:42.256263 dv-cinder-852009-7-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 558/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Mon Sep 12 23:39:42 2022] GET /compute/v2.1/servers/c6c4ec8c-9162-47bf-a5a4-d5ab1b0aaa49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)